TRANSVERSE INSTABILITY OF THE LINE SOLITARY WATER-WAVES 

FREDERIC ROUSSET AND NIKOLAY TZVETKOV 



Abstract. We prove the linear and nonlinear instability of the line solitary water waves with 
respect to transverse perturbations. 
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1. Introduction 



The water waves problem that is to say the study of fluid motions in the presence of a free surface 
has been the object of many studies in the past thirty years. This problem which is highly nonlinear 
is very interesting in many aspects. The study of the well-posedness of the Cauchy problem has 
been widely studied recently [361 IMl SI El [251 [HI [M]- A lot of progress has also been made in the 
rigorous justification of important asymptotic models like the KdV or KP equations [121 [3 l33] . 
Finally, let us also mention that the study of bifurcation of travelling waves [6l |8l [22l [T9] or more 
complicated patterns [lUl [50] has also attracted a lot of attention. An important aspect of the 
theory which is in some sense in the intersection of the above aspects is the study of the dynamical 
stability of important particular patterns like solitary waves. 

Our goal here is to study the stability of the line solitary waves constructed by Amick and 
Kirchgassner in [6] . In the context of the water waves model, in the physical situation, the velocity 
of the fluid depends on three variables, while the free surface of the fluid which is also unknown 
is two-dimensional. We shall refer to this situation as the two-dimensional case. We shall call 
one-dimensional waves or line waves solutions of the water waves equations for which the surface 
of the fluid is invariant by translation in one direction. 

The stability of the line solitary waves when submitted to one-dimensional perturbations was 
studied by Mielke in [26] where a conditional orbital stability result was established. This means 
that, as long as the solution of the water waves equations issued from a small one-dimensional 
perturbation of a line solitary wave exists in the energy space, it remains close to translates of the 
solitary wave in the energy norm. The precise statement is given below. 

Here, we shall prove the nonlinear Lyapounov instability of these waves when they are submitted 
to perturbations depending in a nontrivial way on the transverse variable. For that purpose we 
construct a family of smooth solutions of the water waves equations which give arbitrarily small 
perturbations to a line solitary wave at the initial time and which after (long) times separate from 
the solitary wave (an its spatial translates) at some fixed distance, the distance being measured in 
some natural norm for the problem. More precisely, we prove an instability result in the LP' norm 
which thus implies instability in the energy norm. Our result contains the fact that the solution 
remains smooth on a sufficiently long time scale where the instability can be observed. 

The destabilization of one-dimensional stable patterns by transverse perturbations arises very 
often in dispersive equations. In the early 1970's, using the theory of integrable systems Zakharov 
[38] obtained the transverse instability of the soliton of the Korteweg -de Vries (KdV) equation 
considered as a one-dimensional solution of the (two-dimensional) Kadomtsev-Petviashvili-I (KP-I) 
equation. Since the KP-I equation can be obtained as a long-wave asymptotic model from the 
water waves system in the presence of enough surface tension (Bond number larger than 1/3), the 
situation considered by Zakharov can be thought as a strongly simplified model for the problem 
that we consider here namely the full water waves system with strong surface tension (Bond number 
larger than 1/3). Let us point out that the surface tension seems to have a destabilizing effect. 
Indeed, when the surface tension is weaker (Bond number smaller than 1/3), the asymptotic model 
in the same long-wave regime is the KP-II equation and for the KP-II equation, the linearized 
equation about the solitary wave has no unstable spectrum as shown in [5]. An interesting open 
question is therefore the study of the transverse stability of the line solitary waves constructed in 
[22] in the case of small surface tension (Bond number smaller than 1/3). Note that even for the 
model case of the KP-II equation the nonlinear stability is an interesting unsolved problem. 

The main drawback of Zakharov approach is that a lot of dispersive equations like the water 
waves system that we want to study are not known to be completely integrable. 
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An important feature of most of the important models is that they are endowed with an Hamil- 
tonian structure. This structure in the water-waves setting was exhibited by Zakharov [37]. Never- 
theless, the general framework of Grillakis-Shatah-Strauss [T7j which has been developed in order to 
prove stability or instability of constrained minimizers of the Hamiltonian, and has been successful 
for studying orbital stability of solitary waves in many dispersive models, does not seem to apply 
in transverse stability problems. The main reason is that the two-dimensional energy is infinite at 
the one-dimensional object. 

In our previous works [311 [32] , we developed an approach to study the transverse instability of 
solitary waves for Hamiltonian partial differential equations which applies in the situation consid- 
ered by Zakharov and also to many other dispersive, not necessarily integrable, equations. This 
method inspired by a work by Grenier [16] in fluid mechanics consists in reducing the problem 
to the proof of linear instability for a family of one-dimensional problems by proving that linear 
instability implies nonlinear instability. 

The water waves system with surface tension does not enter in the general framework of |32j . 
Among the main difficulties are the high level of nonlinearity in the equations which makes the 
study of the Cauchy problem for perturbations of the solitary wave non-trivial and the presence 
of a non-local term which does not allow to reduce the study of the equation linearized about the 
solitary wave to the study of ordinary differential equations. Nevertheless, the general philosophy 
of our approach can be used, more details on the description of our approach will be given in the 
end of this introduction. 

The remaining part of the introduction is organized as follows. We first present the water waves 
system. Next, we describe the solitary waves as a special solution of the water waves system. 
Further, we give more details on the result of Mielke [26] about stability with respect to one 
dimensional perturbations. We then state our instability result with respect to two dimensional 
(transverse) perturbations. We end the introduction by explaining the general strategy behind our 
proof. 

1.1. The water v^aves system with surface tension. We shall use the notation Y = {X,z) G 
with X = {x,y) G M?. We consider the situation where the fluid domain which is unknown is 
defined by 



where t is the time, /i is a parameter defining the fixed bottom z = —h and z = r](t,X) is the 
equation of the free surface at time t. We denote by u the speed of the fluid. We consider the 
motion of an irrotational, incompressible fluid with constant density. This means that the velocity 
u of the fluid is given by ti = 'Vyf = {dxfpj dy(j), dz<j)) for some scalar function (j) and hence we find 
that inside the fluid domain $7^, 



On the boundaries of Of, we make the usual assumption that no fluid particles cross the boundary. 
At the bottom of the fluid this reads 



where we use the notation Vx = {dxidyf". Finally, taking into account the surface tension to 
compute the pressure on the free surface, we find the Bernouilli law: 



Oi = {(X, z) G : -h<z< ri{t, X)} 



(1.1) 



Vy ■u = AY(t>= {dl + dl + d'^)(t>{t,x,y,z) = 0, in Of. 



(1.2) d,(l){t,x,y,-h) =0 
and on the free surface, this yields the kinematic condition 

(1.3) dtvit, X) + VxHt, X, r]{t, X)) • Vxr]{t, X) - d,<P{t, X, r]{t, X)) = 0, 



(1.4) dt^t, X, rj{t, X)) + ^\VY<P{t, X, rj{t, X))\^ + ^(t, X) = bV ■ 



Vxv{t,X) 
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where Vy = ( Vx ,dz)- The coefficient b is the Bond number which measures the influence of 
the surface tension and g is the gravitational constant. The term g'i]{t, X) is the trace of the 
gravitational force gz on the free surface. 

It is classical to rewrite the system (jl.ip , (jl.3p , (|1.4p as a system where all functions are evaluated 
on the free surface only. Let us next define the following Dirichlet-Neumann operator: for given 
r]{X) and f{X), we define (j){X,z) as the (well-defined) solution of the elliptic boundary value 
problem 

{dl + + dl)cl) = 0, in {{X,z) : -h<z<r]{X)}, </.(X, r?(X)) = <^(X), d,^{X,-h)=0, 
and we define the Dirichlet-Neumann operator as 



G[7]]^ ^ d.cPiX, r]iX)) - VxviX) ■ Vx^X, r^{X)) = ^1 + |Vx7?|2(Vy0(X, r?(X)) • 
where 

n{X) = ] i-VxriiX), 1) 

is the unit outward normal of the free surface at the point z = f]{X). 

This allows to rewrite the system in terms of the functions evaluated on the free surface only. 
Set 

^{t,X)^cP{t,X,r]{t,X)). 

Then one directly checks that the water waves problem (jl.ip . ()1.2p . (jl.3p . (|1.4p is reduced to the 
study of the following system 

(1.5) dti] = G[rj]^, 

1,^ ,2 , 1 (G[r?]^ + Vxv?- Vx??)2 , ,^ ^xV 



2 2 l + \Vxvr Vl + |Vx??p 

As noticed by Zakharov [37], the system (jl.5p - (jl.6p has a canonical Hamiltonian structure 

dtV = ^, dt(p = - — 
dip or] 

where the Hamiltonian TC is the total energy given by 

n{il,v) = \t [G[r?]^<^ + OT' + 26(Vl + |V77P-l)' 

This is the sum of the kinetic energy, the gravitational potential energy and a surface energy due 
to stretching of the surface. The expression of the variational derivatives of 7i can be checked by 
easy calculation thanks to the following lemma (see [241 Theorem 3.20] for example). 

Lemma 1.1. For an integer k >2, consider the map rj i— > G[r]](p, acting between the Sobolev spaces 
^fc+i/2(j^2) andH''~^/^{R^). Then 



Dr,G[v]ip ■ C = -GMCZ) - V • (^C(Vx9^ - ZVxv) 
where Z, linear in if and real valued, is defined by 

7 , G[ri]ip + Vxv'^xV 

' = '^^^^^= l + |Vx,p • 

Note that because of the translational invariance in the problem, the momentum 
is also a formally conserved quantity. 



The Hamiltonian structure of (|1.5p - ()1.6p will be of crucial importance for many aspects of our 
analysis in particular for the choice of multipliers when performing energy estimates. 

1.2. The line solitary wave solution of the water waves system (|1.5|) - (|1.6p . For c > 0, since 
we shall study solitary waves with speed c, we make a change of frame X = (x, y, z) ^ [x — ct, y, z) 
which changes the dynamical equations (jl.Sp . (jl.4p into 

dtr]{t, X) - cd^r]{t, X) + VxHt, X, r]{t, X)) ■ Vxr]{t, X) - d,4>{t, X, 7?(t, X)) = 

and 

9t0(i,X,7?(t,X))-ca,</.(t,X,r/(t,X))+i|Vy</.(t,X,r/(t,X))|2+OT(t,X) = bV x- ^^"^^^'^^ 



2' Vl + |Vx^(t,X)|2 

By using again the Dirichlet-Neumann operator, the equations (jl.Sp . (jl.6p become 

(1.7) dtJ] = cd^'q + G[ri\ip, 

(1.8) = cd^if- -\VxW + i; , , 1^ gri + bVx 



2' 2 i + ivxr/|2 " yrrpvrf 

where (p is again defined as ip{t,X) = (j){t, X,i](t, X)). A solitary wave with speed c becomes a 
stationary solution (i.e. independent of t) of (jl.7|) . (jl.Sp . To study the existence of such solitary 
waves, it is classical to introduce a non-dimensional version of the equations. Let us perform the 
change of variable 

riit,X) = hfi(^^t,^Xy (^{t,X,z) =ch4>(^^t,^X,^z 

Then the equations satisfied by fj, (p which for the sake of simplicity will still be denoted by t], 
are 

dtvit, X) - d,r]{t, X) + Vx(p{t, X, r]{t, X)) ■ V xr]{t, X) - d,4>{t, X, r]{t, X)) = 

and 

dt^t, X, rj{t, X))-d,cl){t, X, r,{t, X))+i |Vy0(i, X, r]{t, X))\^+av{t, X) = x 



2' ' ^ - - Vl + |Vx^(t,X)r 

where the fluid domain is now {(X, z) : —1 < z < rj{t, X)} and 



c2 

Note that the elliptic equation (jl.ip is not changed. The equations formulated on the free surface 
thus become 

(1.9) dtr] = d,7] + G[7]]ip, 



2' 2 l + |Vxry|2 ' ^ " ^l + |Vx??|2' 

The Hamiltonian is now given by 

H{V,V) = 1: [ \G[r]]ip^ + a7]^ + 2P{yTTWW-'^)-'^vdccV . 

In terms of the parameters a and /?, we have the following existence result (see [6]) concerning 
stationary solutions of (I1.9p - (ll.l0p (or equivalently solitary wave solutions of the original problem 
([13])- (US])). 
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Theorem 1.2 (Amick-Kirchgassner [6]). Suppose that a = 1 + and f3 > 1/3. Then there exists 
Eq such that for every e S (0, eo) there is a stationary solution (i.e. also independent 

of y) of il.9\) - [T7W\) under the form 

r]e{x) = e^9(ex,e), ips{x) = e^{ex,e), 

where Q and ^ satisfy: 

3d>0, VaGN, 3Ca>0, V (x, e) G M x (0, eq), |(5^e)(x, e)| < C^e"'^!^! 

and 

3d>0, Va>l, 3Ca>0, V(x,e) G M X (0,eo), |(0°$)(a;, e)| < C^e"'^!^! . 

Observe that the speeds of the soUtary waves of (|1.5p - (|1.6p built in the above result are close to 
^/gh which is independent of e. 

The profiles 0(^,e) and have smooth expansions in e. In particular for e = 0, we find 

-2/ e 



(1.11) S(C,0) = -cosh , , , 

^ ^ V2(/3- 1/3)1/2 

and hence we recover the KdV solitary wave. 

1.3. Stability with respect to one-dimensional perturbations. A very natural question is to 
study the stability of the solitary wave solutions obtained in Theorem 11.21 Because of the invariance 
of the problem with respect to spatial translations, usual Lyapounov stability cannot hold and thus 
it is natural to study the stability of the solitary wave modulo these translations (orbital stability). 
It turns out that under one-dimensional perturbations the solitary waves of Amick-Kirchgassner 
are (orbitally) stable. 

1 

Let us fix the functional setting. We define the space Z(M) as Z{M.) = H^CR) x (M) where 

hI iR) = {^, yfi= [ 1^1 tanhiei 1(^(01' <+oo,} 

which means that we do not distinguish functions that just differ by a constant. Note that the 
control given by the 11 • 11 i semi- norm in the low frequencies is worse than the one given by the usual 

homogeneous H2 semi-norm. This is the natural semi-norm associated to the Dirichlet-Neumann 
operator and thus Z(IR) is the natural space associated to the Hamiltonian. Nevertheless, to make 
this statement rigorous, we need a little bit more control on the regularity of the surface. We thus 
also introduce for i? > 1 the subspace 

Zfi(M) = {[/= (?7,(/p) G Z(]R), -1 + 1- < ^(x) < R, \\vAl^<R}- 
The result of [26| reads as follows. 



Theorem 1.3 (Mielke [26], Id stability). Let a, (3 and he as in Theorem \l.S\. Then there exists 
ei > such that for every e G (0, ei] and R > 1, the solitary wave {r]s,<fe) is conditionally stable 
in the following sense. 

For every k > 0, there exists 5 > such that : if U = {ri,ip) : [0,T) — > Z/j(]R) is a continuous 
solution of ()1.5p . (jl.6p . which preserves the Hamiltonian 7i and the momentum V and satisfies 
\\U{0) — {r]s,(ps)\\z < 6 then it satisfies 

inf \\U{t,- - xo) - {r,s,^e)\\z < K, G [0,r). 

As stated by Mielke, the assumption that e is sufficiently small can be replaced by assuming 
that a family of solitary waves depending smoothly on the speed exists and that the list of spectral 
assumptions and the condition on the moment of instability necessary in the framework of |17] 
hold. 
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1.4. Main result: transverse nonlinear instability. The situation drastically changes if one 
considers 2d (transverse) perturbations. The main result of this paper is that the solitary wave 
solutions obtained in Theorem 11.21 are (orbitaly) unstable when submitted to two-dimensional 
localized perturbations (transverse instability). Here is the precise statement. 

Theorem 1.4 (Transverse instability). Let a, (3 and e as in Theorem There exists ei > 
such that for every e G (0, ei] the following holds true. 

For every s > 0, there exists k > such that for every 5 > 0, we can find an initial data 
{r]Q{x , y) , (Pq{x , y)) and a time T^ ~ |log(^| such that 

\\{Voix,y),ft{x,y)) - (%(2;),(/9e(x))||Hs(iK2)x//s(iR2) < 5 

and there exists a solution {rj^ {t, x , y) , (p^ {t, x , y)) of the water waves equation lil.9\ )- [T71^) with data 
iVoTfo)' defined on \^,T^\ and satisfying 

inf \\{'rf{T\x,y),ip\T\x,y)) - {r]e{x - a),ipe{x - a))||i2(K2)xL2(R2) > k. 
Let us give a few comments on this result. 

The instability is stated in the norm. This thus implies an instability in the energy norm 
X H2. We shall actually establish the stronger result that the distance of the solution to all 
functions depending on x only is at time T^ larger than k. 

As in Theorem 11.31 the assumption that e is sufficiently small can be replaced by the same 
assumptions as in [26]. Namely, we need that the solitary wave exists and that the linearization of 
the one-dimensional equation about the solitary wave verifies some spectral assumptions. Note that 
we only need the existence of the solitary wave and some stability properties of the one-dimensional 
problem without any additional assumption in order to get the transverse instability i.e £i is the 
same in Theorems 11.31 and 11.41 

Let us remark that our theorem is not conditional: we establish the existence of the solution on 
[0, T^] which is already a non trivial part of the statement. 

1.5. Outlines of the paper. To prove Theorem ll.41 we shall construct the solution = (r/*^, (f^) 
of (irni), (fmi under the form 

where following the approach of [16], is an exponentially growing solution driven by the linear 
instability and y is a corrector that we add in order to get an exact solution of the nonlinear 
equation. There are three main parts in the paper. In the first part, we study the linearized 
water waves equations about the solitary wave, the aim is to construct the leading part of U'^ as an 
exponentially growing solution of the linearized equation with the maximal growth rate. The second 
step is the construction of the remaining part of f/" where we describe how the linear instability 
interacts with the nonlinear term. The last step is the construction of the correction term V where 
we need to study a nonlinear problem. Here are more details: 

• As a preliminary step, in Section [21 we study the structure of the water waves equations 
linearized about the solitary waves {T]s,^eY- By using the fact that the solitary waves do 
not depend on the transverse variable, we can Fourier transform the linearized equation in 
the transverse variable to reduce the problem to the study of a family of linear equations 
indexed by the transverse frequency parameter /c G M : 



(1.12) 



dtU = JL{k)U 

7 



where L{k) is a symmetric operator and J = 




. In the expression of the operator 



L(k) arises the "Fourier transform" of the Dirichlet-Neumann operator Gg^^ defined as 

In order to understand the main properties of the Hnearized equation (I1.12p . we first need 
to study carefully Gs^k- This is the aim of Section [3l The estimates that we establish 
are rather classical when k is fixed, we refer for example to [24], [3], the main novelty is 
that we need to track carefully the dependence in k (especially when k is close to zero) in 
the estimates. We also point out the elementary but very useful property that G^^k as a 
symmetric operator depends on \k\ in a monotonous way. 

• In Sectional we study the properties of L{k). We establish that it has a self-adjoint real- 
ization on X with domain x and study its spectrum. We first get (Proposition 
14. 2p that its essential spectrum is contained in [ck, +oo) where Ck > and > if 7^ 0. 
Next, in Proposition 14.81 we prove that for e sufficiently small, L{k) has at most one neg- 
ative eigenvalue for every k. Note that in the case k = the spectrum of L{k) can be 
described by using the spectrum of the KdV equation linearized about the KdV solitary 
wave as shown by Mielke in [26]. 

• In Section [5l we study the operator JL{k). We prove (Proposition 15. 5p that its essential 
spectrum is included in and locate its possible unstable (i.e. with positive real parts) 
eigenvalues in Proposition 15.21 Finally, in Theorem 15.31 prove the linear instability: we 
show that for some A; 7^ 0, JL{k) has an unstable eigenvalue. This last result is known, 
it was obtained in [28], [18], [7] for example by using different formulations of the water 
waves equation. The proof that we get here is very simple, it just relies on the monotonous 
dependence of L{k) in k and a bifurcation argument based on the Lyapounov-Schmidt 
method. An important consequence of this part is that we get the existence of a most 
unstable eigenmode i.e an eigenvalue o"(A:o) of JL(ko) such that 

Re cr{ko) = sup {Re a, 3k, a € (t(JL(/c))}. 

• Once these main properties are established, we are able to construct the unstable approxi- 
mate solution = {r}°',{p°'). From the spectral properties of JL{k), we take the first part 
U'^ of (see Proposition 16. ip under the form 

= j^e'''^'')^e'^yU{k)dk 

where a{k) is an analytic curve passing through a{kQ). 

• The next step is to construct U"" (Proposition 16. 3P . We look for U"" under the form 

M 
j=0 

where each term must be bounded from above by ~ e'^"^-'"'"^)* with ctq = Re (j{ko). They 
are solutions of linear equations with source terms. The crucial property that is thus needed 
is an accurate estimate for the semi-group of JL{k). Since JL{k) is not sectorial some 
work is needed to establish it. Here, we use the Laplace transform. To control the high time 
frequencies, we use energy estimates based on the Hamiltonian structure of the equation 
and the properties of L[k). For the bounded frequencies, we use abstract arguments based 
on the knowledge of the spectrum of JL[k). 

• The last step is to construct the correction term V which solves a nonlinear water-waves 
equation. This is the aim of Section [71 
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The local well-posedness for the water waves equation has been much studied recently, we 
refer for example to [36], [23], [27], [9], [25], [11], [M]. Here, we want to prove that there 
exists a smooth solution of the water waves equation in the vicinity of the approximate 
unstable solution which remains smooth on a sufficiently long interval of time. Moreover, 
we want a precise estimate between the exact and the approximate solution in order to get 
the instability result. For this reason the approaches like [23] or [27] which are based on 
the Nash-Moser's scheme are not suitable for our purpose. It was noticed in [21] that when 
there is no surface tension, the water waves system has a quasilinear structure once we have 
applied three space derivatives on it. When there is surface tension, the main difficulty 
is that the commutator between a space derivative and the term coming from the surface 
tension contains too many derivatives to be considered as a remainder. This situation arises 
classically in the study of high order wave equations for example 

3 3 

dttu = —\D\^ [a{u)\D\^u), a > ao- 

Note that in 1-D the water wave problem in Lagrangian coordinates is indeed very close to 
this situation (see [33] for example). For such high order wave equations, a good candidate 
in order to get type estimates is to apply powers of the operator |Z?| 2 (o(ii)|D| 2u) to 
the equation. This is the approach chosen in the study of the water waves system in j34j . 

Here, to handle this difficulty we shall use a slightly different approach which is based 
on the use of time derivatives: the energies that we use involve simultaneous space and 
time derivatives of the unknown. The basic block in the construction of our energies comes 
from the Hamiltonian structure of the system, nevertheless, we also need to add some lower 
order terms in order to cancel some commutators. This approach yields slightly simpler 
commutators to compute and allows to get a quasilinear form of the system when there is 
surface tension. Note that our argument provides the well-posedness (without Nash-Moser's 
scheme) of the water waves with surface tension (a result already obtained in [27] via Nash- 
Moser's scheme). A technical difficulty in this section is that we need H'^ estimates of terms 
like 

(G[r/, + 7?» + ,?]-G[r/, + r?'^]).((^, + (^'^). 

This yields because of the solitary wave (since ip^ and their derivatives are not in H^{M?)) 
that we need to study the Dirichlet Neumann operator in a non framework. The final 
argument to get the instability is the one of |16j . 



2. The linearized water waves equation about the solitary wave (%,(/?£) 

In this section, we shall study the structure of the linearized water waves equations about the 
solitary wave. 

In view of Lemma II. Ij in order to express the linear equation arising from the linearization of 
(jl.gp . (jl.lOp about the solitary wave Qg = {rj^, ipi,), it is convenient to use the notation 

Thus 

= ^^^^ rrra^ — ^^^^ • 

We also introduce the operator (of Laplace-Beltrami type) Pe defined by 



1 3 
(l-h|a^%|2)2 (1 + |aa;7?£|2)2 
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Since the solitary wave is one-dimensional, we observe that 



[dxTlsYdxr] 




therefore, the linearization of p.9|) - p.lU|) about {r]g,(pg) reads 
dtr] = dxV + G[r]e]ip - G[r]e]{Zsr]) - d^{ver]), 

dtif = d^if + PeT] - Vsd^if + Z^G[r]s]ip - ZsG[r]e]{Z^r]) - {a + ZsdxVe)r] . 
This linear equation has a canonical Hamiltonian structure and can be written as 

where 



A 



-1 

is skew-symmetric and 

Pe+a + ZeG[r]e] {Ze-)+ Z.d^Ve [v^ - 1)5, - Z,G{^, 

-d^{{vs-\)-)-GW\{Z,-) G[r?,] 

is a symmetric operator. As noticed by Lannes in [24] . we get a more tractable expression of the 
linearized equation if we introduce the change of unknowns 

(2.2) Vi = 7?, V2 = ^- Z,r]. 
Indeed, if (??, ip) solves the system (j2.ip . then (Vi, V2) solves the system 

dtVx = G\ne\V2-d^{{Ve-l)Vi), 

dtV2 = PeVi-{ve-l)d^V2-{a + {ve-l)d^Z,)Vi. 

As noticed in [1] , this change of unknown is linked with the " good unknown" of Alinhac [2] . The 
last system can be written in the canonical Hamiltonian form 

(2.3) dA'(}\=JL^''' 



L 



^V2 J \V2 

where the symmetric operator L is defined as follows 

Ps + a + (vs - l)d,Z, ive-l)d^ 
-d^iv, - !)•) G[r^e] 

Since % does not depend on y, the study of (j2.3|) can be simplified by using the Fourier transform 
in y. Indeed, if for some /c G M, 

(2.4) Vi(x,y) = e^'^yWiix), V2{x,y) = e*^W2(x) 

then 

where the symmetric operator L{k) is defined as 

Pe,k + a+ivs- l)a,Z, {Vs - l)d, 

-d^iiVs - !)•) Ge,k 



m 

with 



and Ge.fc is such that 

(2.5) G[ve]{f{x) eMiky)) = eMiky)Ge,k{fix)) ■ 
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The fact that Gs,k = Ge,k{x, D^, k) is independent of y fohows directly from the definition of 
the Dirichlet-Neumann operator. Note that —Pe,k + a is a positive operator: there exists c > 
independent of fc G M such that for every u S i^^(M), 

(2.6) j^{{-Pe^kU + au)u > cd-ull^i^jj) + {k"^ + 1)1^1^2(18)). 

Note that, for A; G M, we can also define the operator A(A;) associated to A acting on functions 
depending on x only as 



A(e^''^(j^;[^j))=e^''^A(fe) 
We find for A(A;) the expression 
A(^) = 



V2{x) 



Pe,k + a + ZeG^^k{Ze ■ ) + ZAVe - l)<9x - Z^Gs^k 

-d,i{Vs-iy)-Gs,k{Z,-) Ge,k 



^ J X'Ze I 



Due to the change of unknown ()2.2p . we have the relation 

JL{k) = P~^JA{k)P 

where 

P-{1 J). Q-P-^ ' 1 » 

Since P and P~^ are just smooth matrices, JL{k) and JKik) have thus the same spectrum. More- 
over, we also have that L{k) and A(/e) are linked through 

(2.7) L{k) = P*A{k)P, A{k) = Q*L{k)Q 

therefore, it is also possible to relate spectral properties of L{k) and A(k) via the analysis of the 
corresponding quadratic forms. 

In the next section, we shall establish some useful properties on the Dirichlet-Neumann operator 
Gs^k and on the spectrum of L{k). 

3. Study of the Dirichlet to Neumann operator Ge,k 

In this section, we shall study the basic properties of Gs^k- An elementary but very useful 
property that we establish is the monotonicity property of G^^k with respect to k. The proofs of 
most of the other properties are inspired by similar considerations in [31 [24], the point here being 
to track the dependence with respect to k in the estimates. 

Note that, because of the definition (j2.5p . we need to work with complex valued functions. For 
complex valued functions, we shall denote the complex scalar product as 



(3.1) {u,v) = J u{x)v{x)dx. 

We shall use slightly abusively the same notation for the scalar product of x L^, thus for 
U = {Ui, U2), V = {Vi, V2) in L2 X L2, we define 

{U,V) = {Ui,Vi) + {U2,V2). 

Note that we have 

(3.2) Re{JU,U)=0, ^UgL'^xL'^. 

We shall first prove the following statement. 

Proposition 3.1. For every e > 0, we have the following properties: 
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i) Ge,k is symmetric : 

{Ge,kU,v) = {u,Ge,kv), U, V £ H^2 (R) . 

ii) If \ki\ > \k2\, then G^^ki ~ G'£,fc2 ^-^ positive definite operator : 

{Ge,k^u,u) > {Gs,k2U,u), Vug H^M.), u / 0. 

iii) There exist c > and C > such that for every k gM, we have 



(3.3) 



{G,,ku,v)\ < G 



(3.4) {Ge,kU,u)>C 



L2 



L2 



L2 



Vli, V £ i?2(]R), 



Note that the estimates of the above proposition have a sharp dependence in k. In particular, 
3.3p . (|3.4p are uniform in /c, /c € M. We do not care on the dependence of these estimates in e. 



Proof of Proposition \3. 1[ We first prove i). We recall that by definition, we have 

Ge,k(.u){x) = Vl + (5.%(x))2(V,,,(/.^(x,r/,(x))-n(x)), 
where (p^{x, z) is the solution of the elliptic problem 

(3.5) {dl-k"^ + d'^)f = 0, -1< z <rieix), X gM. dj{x,-l) = 
such that 

(3.6) f{x,r]ir{x))=u{x), x G R . 

The identity i) will be a simple consequence of the Green formula. Indeed, let us set D = {(x,z) : 
—l<z< %(x)} and T, = {z = ??e(x)} U {z = —1} and consider (j)"^, (p^ the solutions of (|3.5p . 
with respective traces u and v on the upper boundary. Then, by definition, we have 

{Ge,kU,v) = / Ge,kU{x)v{x)dx 



d' 



HT)cPl{T)dnr) 



'n 



where (iS(r) is the volume element of the surface z = ri^{x). Consequently, since 9z(/)^(x,— 1) 
52(/)^(x, — 1) = 0, the Green formula and the equations satisfied by (^^, (j)^. yield 



(3.7) (G,,fcn, v) = ■ Vx,zrk + k <t^l<Pl) dxdz = (n, Gs,kv) . 

This proves i). 

Let us now prove ii). We first observe that if u is real then G^^kU is also real. Therefore, if 
u = ui + iu2 with real valued ui and n2, we have that 

{Ge,ki^,u) = {Gs,kiUi,Ul) + {Gs,kiU2,U2). 

Consequently, we can assume that u is real valued for the proof. Thanks to (13. 7p . we have 



{Ge,kiU,u) 



D 



> 



D 



D 



{\v.,.rkf + kMf 
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dxdz 
dxdz + {kl - kl) 
dxdz 



D 



I ^ dxdz 



since |A;i| > \k2\ and u ^ 0. Next, since and (p^^ verify the same boundary conditions, we have 



u |2 



thanks to the variational characterization of (j)^^ that 

Jd Jd Jd 

Consequently, by using again (j3.7p . we get 

Jd Jd 

This proves ii). 

We can now prove iii). Note that here, since 77^ is smooth and fixed, we do not care on the way 
the estimates depend on the regularity of rj^. 

Next, to prove (|3.4|) . (j3.3|) . it is convenient to rewrite the elliptic problem (j3.5|) in a flat domain. 
We can define implicitly a function -(/'^ on the flat domain 5 = M x (—1, 0) by 

Since we have by the chain rule 

(3.8) V<t>l{x, z) = M(x, z)VC(^, mix, z)), 
where 

m{x,z) = - -— , M{x,z)={ „ ^ 

we also get by using that the divergence is the adjoint of the gradient that for a vector field 
u{x, z) on D such that 

u{x, z) = z)), z) = (x, m(x, z)) 

we have 

V • n(x, z) = det {D^{x, z)) Vy • (det(L>$-^(y))M($-i(y))*u(y)' 
This allows to get that 

where the operator defined as 

(3.9) A,(V') = (det(5))-^/2div((det(5))i/2^-iVV') 

is the Laplace Beltrami operator associated to the metric g which is defined through its inverse 
by 

9-\x,z)^[ a.,.i.)iz+i) =M{^~\x,z)yM{^~\x,z)), {x,z)GS. 

Consequently, if (j)^ solves 

[dl -k^ + dl)4> = 0, X G M, -l<z< 7]e{x), 
with boundary conditions (/>(x, ?7£(x)) = u{x), dz4>{x, —1) = then ijj^, solves 

(3.10) (-Ag + A;2)V' = 0, {x,z)eS d^^ipix, -1) = 0, 'ip{x,0) = u{x) , 
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/Y=<S>{x,z) 



where S is the strip 5 = M x (—1, 0). By using (j3.8p . the map G^^k can be expressed in terms of 



as 



(3.11) G,,fc(u)(x) = -d,ve{x)d,rk{x,0) + l±i^i!^ii^5,C(^,0) . 

1 + %(x) 

Therefore, using the Green formula together with (|3.9p and the equation solved by ip"^, we obtain 
that for u,v G H^R), 

(3.12) (G,,fc(n),i;) = / (^-iV,,,^ • V~i^ + /cVfcv) (det 5)5dxdz, 
where v can be any function on S such that v(x,0) = v{x). 

To estimate the solution ^'j^ of ()3.10p . we shall use the decomposition 

(3.13) rk=u^ + nl, 
where is the solution of 

(3.14) {-A,^, + k^)uj^ = 0, ix,z)£S, d,u^{x,-l) =0, (x, 0) = n(x), 

S being again the strip R x (—1,0), and thus the remainder u^. is the solution of the elliptic problem 
with homogeneous boundary condition 

(3.15) {- Ag + k^)ul = {Ag-k^)u^, {x,z)£S, d,ul{x,-l) = 0, 4(x,0)=0. 

By solving an ODE, one can write down explicitly the expression of the Fourier transform in x, 
of n^. We have: 



(3.16) uj^{^,z) = ^7 " -m, eGK,^G(-l,0). 

cosh y + A;^ 

The estimate of ijj^ will be a consequence of the two following lemmas. 

Lemma 3.2. There exists C > such that for every A; € M, every s G M, every u G H°°{E.), 

(3.17) ||A%f 11^2(5) <C7|A^A7nU2, 



(3.18) ||A^9,7xf 11^2(5) < C\A'^Dl + k'^K^ ^nj^^ 

where A and A^ are the Fourier multipliers 



K={l + Dl)i, Kk = {l + k' + Dl 



|2. 



Proof of Lemma \3.SX First, we observe that it suffices to consider the case ,8 = 0. Next, we note 
that there exists C > such that for every w > 0, we have the inequalities 

^ y_i cosh2(w) - l + oj cosh2(tj) - l + uj 

Indeed, inequalities p.l9p can be easily obtained for instance by performing the change of variable 
z' = {l + z)u:. Now ([OTP and (|3l8]) follow from (|3T9]) with oj = ^/^^Tl^ via an application of 
the Parseval identity. This completes the proof of Lemma 13.21 □ 

Let us now give the needed estimates for u^. 
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Lemma 3.3. Let us fix an integer s > 0. There exists C > such that for every k £ M, every 
u G ff°°(]R), the solution of (|3.15|) satisfies the estimate 

(3.20) ||A^V.,Xlli^(5) + A:2||A^4lli2(5) < C\A^ ^^^^^u\l,. 

(1 + y^fTF)^ 

Remark 3.4. By a standard density argument, the statement of Lemma \3.S\ and Lemma \3.3\ may be 
extended to functional classes such that the right hand-side of the corresponding inequalities makes 
sense. 

Proof of Lemma \3.3l We have the following estimates 

(3.21) IIA'^V^XIli^c^) + ^'l|AXIli2(5) ^ C{\\A'V,,,uj^\\l,+k^A%^\\l,). 

Indeed, (j3.2ip for s = 0, is just the standard energy estimate: it suffices to take the L^ scalar 
product of equation (j3.15p with and to perform integration by parts by using that satisfies 
homogeneous boundary conditions. For s > 1 one may apply the standard argument for propagation 
of higher regularity in linear elliptic equations. Using (j3.21|) and Lemma 13.21 yield (j3.20p . This 
completes the proof of Lemma 13.31 □ 

We are now in position to get (j3.3p . Thanks to (j3.12p . we have 

(3.22) {Ge,ku,v)= j {g^^V:,,M-V^^ + kmr^{deig)'^dxdz. 

J s 

Consequently, (j3.3p follows by using the Cauchy-Schwarz inequality and (|3.13p . (|3.17p (with s = 
0, 1), (fXTH]) (with s = 0) and (with s = 0). 

As in [3], (|3.4p will be a consequence of the trace formula. Let us choose x(-z) a smooth compactly 
supported cut-off function such that x(0) = 1 ^-^id x is supported in (—1,1). We shall consider 
jp{x,z) = x{z)ip'^{x, z). Note that since x does not depend on x, we have ip{(,,z) = xiz)ilj]^{x, z). 
We can write 

\u{o\^ = mM' < 2 j''^m,z)\\dM.z)\dz 

, 
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< c / ^[\rk{i,z)\' + \dM{i,z)\\rk{i,z)\]dz. 



This yields 



m\^<c r [{e+k^m{^,z)\'' + \dMc,z)\^)dz. 



e + k'^ 

Consequently, we can integrate in ^, use the Parseval identity and (j3.22p to get 

. u\<C [ (g-^V,,,i>t-^^ + k^m^)idet g)Uxdz = {G,,kU,u) . 

(l + /DfTF)2 Js\ ) 

This ends the proof of (j3.4p . The proof of Proposition 13 . 1 1 is completed. □ 

We next establish some additional qualitative properties of Ge,^- 

Proposition 3.5. The operator Ge,k verifies: 

i) For every /c G M, Ge^k G B{H\ H''^'^) for every s G M. 

ii) G^^k depends continuously on k for k £ M and analytically on k for k G IR\{0} in the 
operator norm of B{H^ , L^). 
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iii) For every k, we have the decomposition 

(3.23) Ge,k = \D^\ + Glk{x,a,) 

where for every k, G^^. is a bounded operator on , G^/. G B{H^ ,H^) for every s. 

Note that in this lemma we state mostly qualitative properties of G^^k which hold locally in k. 
An immediate corollary of (j3.23p is that G^^k verifies an elliptic regularity criterion. 

Corollary 3.6. If u e is such that G^^kU G , then u £ H^^^. 

Proof of Proposition \3.5[ We first prove i) . By using (|3.12p , we get 

(3.24) {A'~-2Ge,kiu),v) = (G,,,.(n),A^-^t;) 



[g'^V.M • V,,,(A^-^t;f ) + A:2^^A^-5^;f )(det g)Uxdz, 



where is defined by 



Next, we write 



, COsh(Vlj2 + fc2(z + l)) 

cosh y' D"^ + k"^ 



(A^-5G,,fc(u),i;) = / (^-iV^.^A^V'fe •V,,,(A-^i;f) + A;2A>^A-^?;f)(det g)"2dxdz+ 
J s 

[A^ (det <7)^5"']V.,.7/'fe • V,,,(A-^i;f ) + A:2[A^ (det g)\]rk^rlvAdxdz. 



For s > 0, an integer, we can apply the Cauchy-Schwarz inequality, Lemma [32] and Lemma [33] to 
get the bound 

\{K'~'2Ge,kU,v) \ < C{kW+'2u\L2 \v\l2 

and hence 

\Ge,kU\^,^i < C{k)\u\^^_^i 

(note that for this estimate we do not need to express precisely the dependence of C{k) in k). 
Therefore Gg^^k is continuous from to H'^~2 for s > an integer. By interpolation G^^k 

is continuous from to H^~^ for s > 1/2. Next, since G^^fc is symmetric, by duality G^^k is 
continuous from H^~^ to for s > 1/2. Thus Gs,k is continuous from H'^ to H^~^ for every 

sGR. 

Let us turn to the proof of ii). We shall first establish the continuity at zero. To study [Ge^k — 
Gsfl)u, we consider again the solution of (j3.10p and we shall use the expression 

(3.25) Ge,k{u){x) = -a,r?,(x)a,^^(x,0) + l±i^iM^a,V^^(x, 0) . 
We first notice that — tpQ solves the elliptic equation 

(3.26) ^g{rk-r,) = k'rk 

with a homogeneous Dirichlet boundary condition on the upper boundary 

(^^-C)(^,o) = o. 

Note that this implies by the Poincare inequality that 

\\rk-rAL^is)<c\\v{rk-ro)\\LHsy 
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Consequently, from the elliptic regularity, we get from (j3.26p that 

\\rk-^UH^(s)<ck'\m\L^- 

Therefore, the trace theorem and the definition (j3.25p yield 

By using the Poincare inequality and Lemma 13.21 and Lemma I3.3|, we get 

\m\LHs) < ciivrdLHs) < c\A-\Di + ef^u\L2. 

Therefore, we obtain that for \k\ < 1, 

\mL^<c\u\^^. 

Consequently, we get that there exists C > such that for every |A;| < 1, 



\{Ge,k - Ge,o)u\L2 < Ck^ 



\u\ 



. 1 



which proves the continuity of Gg^^ at zero as an operator in B{H^ , L?') which is even better than 
the claimed property. 

To prove the analyticity, it suffices to use again the decomposition (j3.13p for From the 
explicit expression, of , we get that it depends analytically on k ioi k ^ 0. Then also depends 
analytically on k since can be expressed as 

= Rg{k^)F{k) . {u^) 

where Rg{X) = (Ag — A)~^ is the resolvent of the Laplace Beltrami (with mixed boundary con- 
ditions) operator and F{k) is a linear operator depending on . Since F and Rg depend 
analytically on k for fc 7^ 0, the result follows. More precisely, from the above considerations and 
very crude estimates, it follows immediately that G^.k depends analytically on k in the operator 

norm B{H^ , L^). From the Cauchy formula and the fact that G^^fc belongs to B{H^, L^) this yields 
the analyticity of Gg^k as an operator in B{H^, L^). 

The proof of iii) which is for example detailed in |24j where moreover one tracks the dependence 
of the estimates on the regularity of the surface (see also relies on the construction of a 

parametrix for the elliptic equation (|3.1Up . Let us just give the main steps in the argument. We 
define the operator A^*' = Ag^{x, z, D^., D^) as 

, _Jo^ + b^. + il + vs)-HD.)^ u ^ bdx + , ,rHDx) 

^ \ a J \ a 

where 

_ l + {z + iy{dxVe{x)? , dxVe{x){z + l) 

a = a{x,z) = — — -— , b = b{x,z) = — — -- — . 

{l + r]e{x)y l + r]e{x) 

Using some basic pseudo-differential calculus, one can show that A^^ is a good approximation of 
—Ag + k'^ in the sense that 

(3.27) IK- A, + k^) - Af\\Hs+i^s)^HsiS) < Cs,k . 

If we set ri±{x, z, D^) = a~^{—bdx ± (1 + rj^)"^ {Dx)) then 

A7 = -a{d, - r/_(x, z, Dx)){d, - 7?+(x, z, Dx)) . 
We next find a parametrix (pap = 4>apix, z, Dx) for Ag^ such that {4>ap) /z=o — ^d. This is given by 



'^ap 



exp(- / r]+{x,z',Dx)dz'), ze[-l,0]. 

J z 



17 



This linear operator <j)ap enjoys heat-flow type smoothing effects. Finally we have on the one hand 

and on the other hand that 

The result thus follows by proving the bound 

(3.28) I'^xA'^k - (l^ap{u)){x,0)\Hs(^M) < Ck,s\u\H=(^R) 

which is a consequence of the properties of (pap and elliptic regularity for the problem solved by 
tp^ — <j)ap{u). This completes the proof of Proposition 13.51 □ 

Remark 3.7. Using the arguments of [351 Chapter 7.12], one may show that 

G[Ve] - 



|I),|2 + |Z)j,|2(l + (a,??,(x))2) 

is a zero order pseudo-differential operator, independent of y, and thus its symbol q{x, (,1,^2) satisfies 

(3.29) < c^aa{\Ci\ + 161)"^^"^^ < c^AAi^ir"'-'"' ■ 

Thus part iii) Proposition 13.51 is also a consequence of (13:29]) with (32 = and the boundedness 
criterion for zero order pseudo-differential operators. 

In the next proposition, we give useful commutator estimates. 

Proposition 3.8 (Commutators). We have the following properties: 

i) For every s >1, K > 0, there exists Cs,k > such that for every u £ H'^^^ , 

\DJ 



(3.30) 



\[d!,,Ge,k]u\^.<Cs,K 



-U 



+ \k\\u\H-), yk,\k\<K. 



(3.31 



l + \D.^\2 

ii) For every K > and every smooth function f{x) £ 5(M), there exists Ck > such that 
for every u £ H2 , 



Re[fda:U,Ge,kU 



<Ck 



L2 



+ \k\\u\L2], yk,\k\<K. 



Note that in this proposition we do not pay attention to the dependence of the estimates in k 
for large k, since this will not be needed. 

Proof of Proposition \3.^ To prove i) , we shall estimate 

/ = {A^dlG,,kU,v) - {K^G,^kdlu,v). 

By using again (I3.12p . we write 



I 



{-ly I {g~^V^,,M ■ V,,,A-2d^^vjf + feVfc A^^^^f ) (det^)^ dxdz 
- (<7~'V,,,V?" • V^,,k-2v^ + fc^V;^^" aIz;^ )(det5)^ dxdz 

I (5-'(V.,,«- V,,,V'?") • V,,Mv^ + k\dirk - ^f^")Al^)(det 5)^ dxdz 
+ I (\dl (det5)^5~'] V.,.V.^ • V,,Mv^ + A;2([a^, (det 5) ^ ] ) dxdz 

= Jl + J2. 
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We estimate the second integral above by 

IJ2I < Ci^(||A5t;f 11^.(5) ||[af.,(det<7)5<7-^]V,,,CLi(5) 

+ |/c|||A5T;f 11^2(5) ||[5^,(det<7)5]^^||^,^^^ 
and hence, by using again Lemma 13.21 Lemma 13.31 and standard commutator estimates, we find 



IJ2I < C.k\v 



-u 



In a similar way, we estimate Ji as follows 



\Ji\< CsMAl^ (||v.,.« - v,,,^'?"!!^,^^) + \k\\\dirk - 

To conclude, we notice that ijj = d^ip)^ — V'f''" solves the elliptic equation 

(3.32) -A,^ + A;V= [5^,A,]C 

with the homogeneous boundary conditions 

(9^^(x,-l) = 0, i{j{x,0)=0. 

Consequently, the elliptic regularity estimates for (j3.32p . the Poincare inequality and again 
Lemma l3. 21 and Lemma 13.31 yield 

\DJ 



\Ji\ < Cs,k\v\l^ 
This ends the proof of i). 

Let us now prove ii). We use again (j3.12p to write 

iGe,kU, fdxu) = 



-u 



+ \k\ \u\h^ 



+ 



g^^^^^k ■ dxi^k V/ + k'^lfd^i^l ) (det g) t dxdz 



= h + h. 

By using again Lemma 13.21 and Lemma 13.31 we immediately get that 



\h\< Cs,K 



L2 



+ \k\Mh 



l + \D.,\-2 

To estimate /i, we first integrate by parts to obtain 

a47(detg)^5"l)VV^ Wfd3;dz 



2 Re/ 



and then by Lemma 13.21 and Lemma 13.31 we also get 



iRe/il < Cs K 



l + \DJ-2 



-u 



+ \k?\u\l2 



L2 



This yields the desired estimate for Re [G^^kU, fdxu). 
This ends the proof of Proposition 13. 8[ 
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□ 



Let us set 



Gfc[r?]n = e-''=^G[r/](ne 



iky\ 



for functions rj{x), u{x) which depends on x only. We are interested in estimates of D^Gk[i]e]u 
(/ii, . . . , /ij) . We shall use the notation 

D^^Ge,kU ■ {hi,..., hj) = DljGk[r]e]u ■ {hi,..., hj). 
Proposition 3.9. For every s > 1/2, we have the estimate 



(3.33) 



D{Ge.kU ■ {hi,. 



5 ^H"-^^ 



i=l 



Proof. It suffices to take the derivative of (|3.24|) with respect to r] and then to use the standard 
Sobolev-Gagliardo-Nirenberg-Moser estimates for products in Sobolev spaces and again Lemma [3.2 
and Lemma 13.31 This completes the proof of Proposition I3.9[ □ 



4. Study of the operator L{k) arising in the linearization of the Hamiltonian 
As a preliminary, we first establish the following statement. 

Lemma 4.1. L{k) has a self-adjoint realization on L^(IR) x L^(M) with domain H^{M.) x H^{M.). 

Proof. We first notice that L{k) enjoys an elliptic regularity property, namely if u = {ui,U2) S 
X is such that L{k)u ^ L'^ x L'^ then u £ x H^. Indeed, using the first equation and 
the elliptic regularity for the second order operator Pe^kj we obtain that ui G H^. Then, using 
the elliptic regularity for G^^k established in Corollary 13.61 and the second equation, we obtain that 
U2 £ H^. Finally, using again the elliptic regularity for P^^k^ we obtain that ui € H^. 
Next, we also observe that L{k) is symmetric in H°° x H°^, namely 

(4.1) {L{k)u,v) = {u,L{k)v), yu,v e H°° X H°° . 

Moreover, let us consider the closure L{k) of L{k) defined on the domain 

D{L{k)) = {u^ X : 3u„ G H°° x H°°,Un u in L? x L? , L{k)un converges in x L^}. 

We shall show that L{k) is self adjoint and that D{L{k)) = x H^. By definition, the adjoint of 
L{k), denoted by L{k) has the domain 

D{L{k)*) = {ue L'^ X : 3C> 0, \{u,L{k)v)\ < C\\v\\L2y,L^, Vt; G D{L{k))} 

and moreover, the following inclusions hold: 

X C D{L(k)) C D{L{kf) C x hK 

Indeed, the first inclusion follows from the density of x in x and the fact that L{k) 
is continuous from x to L"^ X L?'. The second inclusion follows from the fact that L{k) is 
symmetric (see (j4.ip ). The third inclusion is the most difficult to check. It follows from the elliptic 
regularity, since D{L{k) ) can be also seen as the function in x such that L{k)u (a priori 
defined in a weak sense) belongs to x L^. This completes the proof of Lemma |4.1[ □ 
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4.1. Essential spectrum. Our aim is now to locate the essential spectrum of L{k). 

Proposition 4.2. For every e G (0, eo]; and for every A; G M, there exists > 0, such that 

aess{L{k)) C [ck,+oo) C [0, +oo). 

Moreover, for k ^ 0, we have > 0. 

Note that for k ^ the essential spectrum of L{k) is included in (0, +oo). 

Proof of Proposition \4-^ Since L{k) is self-adjoint, its spectrum is real. We thus only have to prove 
that 7 + L{k) is Fredholm with zero index for j > 0, k ^ and for 7 > 0, /c = 0. Towards this, we 
shall prove that L{k) + 7 can be written as 

L(A:)+7 = J(7,A;)+/C(7,A;), 

where ^(7, k) is an invertible operator for 7 > with domain x and /C(7, k) is a relatively 
compact perturbation. 

Let us first have a look to the asymptotic behaviour of the coefficients of L{k). In Theorem II. 2 1 
we have already recalled that rj^, dxfe and their higher order derivatives have an exponential decay 
towards zero at infinity. Moreover, since for a solitary wave, we have G[%](/?e = — we also get 
that G[%](/3e and its derivatives tend to zero exponentially fast at infinity. This yields in particular 
that and dxZ^ have an exponential decay towards when x tends to ±00. Consequently, we can 
first write the decomposition 

L{k)+j = Lo{-f,k) + C{k), 

where 

-/3C-'a2 + + a + 7 -{i-v,)dx 
dx 7 + Gs,k 



SPC^'dx - Pk^l - C-l) + {Ve - l)dxZe 
-dx{Ve-) 



-^^0(7,^) 

and 

C{k) = 
where C is defined as 

C(x) = (l + (9,r?,(x))2)l. 

Note that the function C(x) has an exponential decay towards 1 when x tends to ±00, while its 
derivatives decay exponentially to zero. 

The domain of Lo{j, k) is again x H^. Consequently, thanks to the exponential decay in its 
coefficients, we get that C{k) is a relatively compact perturbation i.e C{k) seen as an operator in 
X i/i,L2 X L^) is compact. 

Next, by using that there exists eo > such that for e < Eq we have 1 — tig > 0, we write the 
factorization 

Lo(7, k) = AiLi(7, k) + Ci(7, fc), 



where 



I3{1 - Vs)-\-^dl + (3e + a + j -dx 
dx 7 + Gsh 



Li{7,k) = 
Ci(7,^)=((^'' + « + ^^^^ I) 



l-Ve 
1 



Note that Ci(7, k) is again a relatively compact perturbation because of the decay of Ve at infinity, 
while Ai is just an invertible matrix. We can simplify Li^-j, k) a little bit by writing 

Li(7,A;) =L2(7,A;)5i + C2, 
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where 

( -^dl + + a + 7 -d^ 
\ dx 7 + Ge,k J ' 

1 y ' 

- ve)~\-^ d^] - iPk^ + a + 7)(1 - C-'(l - Ve)'') 
dJ{l-C-^{l-Ve)-')-) 



Bi -- 

C2-- 

Again, we see that C2 is a relatively compact perturbation since because of the decay of its coef- 
ficients it is compact as an operator in B{H^ x H^,L^ x L^). Moreover, Bi is just an invertible 
matrix. 

Next, to simplify the expression of L2, we shall use a factorization inspired by the work of 
Mielke |26j . Thanks to (j3.4p . we note that the operator 7 + Ge^k satisfies for some c = c{k) > the 
estimate: 

{{j + Ge,k)n,u) >c( . ^l+il + k^Mh). 

Consequently, for 7 > and > or for 7 = and /c > we have that for some c > (depending 
on 7 and k\ 

(4.2) ((7 + G,,fc)n,tx) >c|n|2 1. 

ti 2 



- \v\ 1 



Moreover, thanks to (|3.3p . we also have that 

((7 + Ge,fc)n,t;) < C|u|^i 

thus the quadratic form ((7 + Gg^k)',') is continuous and coercive on H^. By the Lax-Milgram 
lemma and Corollary 13. 6^ we thus get that the operator 7 + G^^fc defined on with domain 
is invertible for every (7, k) such that 7 > and A: > or 7 > and k = 0. The existence of 
(7 + Gi;^k)~^ allows to introduce the factorization 

L2i-f,k) = A2i-f,k)L3{j,k)B2i-f,k) 



where 

^3(7,^) 
A2{l,k) 



-/?5,, + /3A;2 + a + 7 + a,(7 + G,,fc)-ia, 

7 + Gs,k J ' 

1 -5.(7 + G,,fc)-^ 



1 



Note that ^2(7,^) and i?2(7,fc) are bounded invertible operators on X L^. To get our last 
simplification, we shall prove that the operator 

(4.3) a,(7 + Ge^kr^d^ - 5,(7 + Go,kr^d, 

is a compact operator in B{H^ x H^,L^ x L^), where the operator Go,fc is the Dirichlet Neumann 
for the flat surface ij = 0, 

Go,kU = e-"'yG[0]iue"'y). 
Coming back to ()3.16p . we obtain that Go,fc is a Fourier multiplier, namely 



Go,k = tanh(D2 ^ fc2)/DfTfc2 . 



In order to study the compactness properties of (14. 3p . we shall use the following lemma. 
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Lemma 4.3. The operator = G^^k — Go^k is a bounded operator in B{H^,L?') and a compact 
operator from to Lp' for every s > 1 . 

Let us postpone the proof of Lemma 14.31 We now show how we can end the proof of Proposi- 
tion [32] by using Lemma l4.3i We write 

7 + Ge,k = (Id + 4^))(7 + Go,fc), Rf^ = Reil + Go,fc)-^ 
We have that Id + R^e^ is a bounded invertible operator on Lp' and 

(Id + 4^))-^ = (7 + Go,fc)(7 + Ge^u)-^. 
Moreover, thanks to Lemma 14.31 and since (7 + Go,fc)~^ is a bounded operator from to H^~^^, 
we get that R^e^ is a compact operator from to for every s > 0. Next, since 

(Id + 4^))"^ = Id - (Id + 

we get that (Id + R^'^)~^ = Id + R^e'^ where R^'^ is a compact operator from to for every 
s > 0. To conclude, we write that 

(7 + Ge,k)-^ = (7 + Go,fc)-nid + R^P)-^ = (7 + Go,k)-^ + (7 + Go,fc)~^i?f 
which yields 

dxil + G,,fc)-ia,. = 5x(7 + Go,fc)"^ax + 9,(7 + G^^kT^Rf^d^ 

and we observe that i9x(7 + Go,fc)~^ is a bounded operator on L^, that dx is a bounded operator 

from to i?^ and that R^e^ is a compact operator from to L^. Consequently, we have obtained 
that 

dx{i + Ge,k)-^dx = dx{i + Go^k)-'dx + Ri^\ 
where is a compact operator from to L^. This finally allows to write that 

L3(7,A;) = L4(7,A;) + G3(7,A;) 

where 

r k-\-f + + a + 7 + 5x(7 + Go,k)-^d, 

^'^^'^^"V 7 + G.,, 

and G3(7, A;) is a relatively compact perturbation. 
Gathering all our transformations, we find that 

(4.4) 7 + L{k) = ^1^2(7, k)L^{j, k)B2{j, k)Bi + JC 

where /C is a relatively compact perturbation for 7 > 0, /c 7^ and for 7 > 0, A: = 0. Consequently to 
get that 'y+L{k) is Fredholm with index zero, it suffices to prove that j4ij42(7, k)L4{'y, fc)i?2(7, k)Bi 
is invertible. Since Ai, A2, Bi, B2 are bounded invertible operators, we only have to prove that 
L4{'y,k) is invertible. Moreover, we see that L4 is a diagonal operator and we have already seen 
that 7 + Gs,k is invertible for 7 > 0, A; 7^ or 7 > 0, A; = 0. Therefore, it only remains to study the 
invertibility of 

-pdl + /?A;2 + a + 7 + 9,(7 + Go,k)~'dx. 
This operator is just the Fourier multiplier by 

m{0 = Pf + f3k'^ + a + -/ ^ 



> + /3A;2 + a + 7 



7 + tanh(Ve^+F) + P 



tanhl^l ■ 

As observed in [26], we have the following statement. 
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Lemma 4.4. For (3 > 1/3, we have the inequality 



Px"- Vx>0. 

Proof. Let us set /(x) = - ^^j^f-^, then f'{x) = g{x)/{e^ — e~^)^, where 

g{x) = 2/3x(e2^ + e'^^) - (e^^ - e'^^) + (4 - 4/3)x . 

We have that near zero g{x) = 8{(3 — l/3)x'^ + 0{x'^) and that 

(7(^)(x) = 32/32;(e2^ + e-^^) + 16(4/? - l)(e2^ - e'^^) > 0, Vx > 0. 

Hence g^^\x) is an increasing function and since for /? > 1/3, ^^^^(O) > 0, we obtain that g^^\x) > 
for every x > 0. Next, in a similar way, we obtain successively that g (x), ^'(x) and ^(x) are non- 
negative. Therefore /(x) is an increasing function which imphes that for every x > 0, /(x) > 
/(O) = —1. This ends the proof of Lemma 14.41 □ 

Using Lemma 1331 we get 

> + 7 + a - 1. 

Since a = 1 + e^, m{S,) is uniformly bounded from below by a positive number for 7 > 0. Conse- 
quently, the operator L4 is invertible. To end the proof of Proposition 14.21 it only remains to give 
the proof of Lemma 14.31 . 

Proof of Lemma \4-3[ Thanks to the fundamental theorem of calculus, we can write 

{Gs,k - Go,fc)v5 = e-^^y C {D,,G[siieW''y^) ■ r?,) ds. 

Jo 

Using Lemma ll.H we have 

(4.5) (Ge,fc-G'o,fc)v9 = - Gk[sris]{r]sZk{sr]s,ip)) - dx{ve{dx'f - sZk{sr]s, (p)dxVe)) + k'^VeV^ds, 
where we use the notations 



x 



In this formula, it seems at first sight that {G^^^ ~ G^fc) is a second order operator. Nevertheless, 
by using iii) of Proposition 13.51 basic commutator estimates and the decay of 77^ and its derivatives, 
we get that 



where the operator 7?. is a sum of terms which are all made of the product of a first order (pseudo 
differential) operator i.e. belonging to B{H^ ,H^~^) and of a rapidly decreasing function. This 
yields that TZ is compact as an operator from to L?' for every s > 1 and ends the proof of 
Lemma 14.31 □ 



This also ends the proof of Proposition 14.21 □ 
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4.2. Negative eigenvalues of L{k). The next step is the study of the eigenvalues of L{k) outside 
the essential spectrum. 

As in [26], it is convenient to introduce a reduced operator in order to study the eigenvalues of 
L{k). We first define the operator 

where is defined by the division by iS^ in the Fourier space. Note that M is well-defined for 
smooth functions whose support of their Fourier transform does not meet zero. To study M, it is 
convenient to introduce the bilinear symmetric form 

Q{u,v) = {Mu,v), 

for u,v G H'^iM) such that u, v have supports which do not meet zero. 
We have the following statement: 

Lemma 4.5. Q extends to a continuous and coercitive bilinear form on H^^ x H^^ . 

As a consequence of this statement, we get thanks to the continuity of Q that M is well-defined 
as an operator in B{H~2^H2). Moreover, thanks to the Lax-Milgram lemma, we can thus define 
the inverse as an operator in ;S(i72 , ff~2 ). By using (|3.23|) in Proposition \'i.b\ we can then 

get that M is a continuous bijection from to H^'^^ for every s G M. 

Proof of Lemma |^.5| . We notice that 

Q{u,v) = {Ge,od~'^u,d~'^v) 
consequently, thanks to (13. 3p in Proposition 13. 11 we get that 



\Q{u,v)\ < C\u\^_i \v\^_i. 



In a similar way, we get that 

Q{u, u) > c|up _ 1 

thanks to (|3.4p . This ends the proof of Lemma 14.51 □ 
Next, as in [26], we can use the operators M and to notice that 

(4.6) {mU,U) = ((-Pe,o + a-7AZ,)C/i,C/i) - (M-i(7e[/i),7.t/i) 

+ (m(5,.[/2 - M~\jeUi)),d^U2 - M-i(7,[/i)) 
where we have set 7^ = 1 — 'Ug. Since M is nonnegative, we obtain that 

{mu, t/) > (( - Pe,0 + a - led^Z,)Ui, f/i) - {Ar\jeUi),jeUi) = {A,Uu Ui). 
By using that for the solitary wave we have G[?7e](^£ = —5^%, we get that 

Therefore, we obtain the expression 

(4.7) AeT] = -PefiT] + UT] + 7edx{ledxVe)r] - -feM''^ (jeV) ■ 

The spectrum of the operator is studied in [26]. Note that our notations are slightly different 
from the one of Mielke in [26], in particular, here a is the rescaled coefficient coming from the term 
taking into account the gravity in the equation. After a suitable rescaling Ag; tends (in a rather 
weak sense) to the operator obtained by linearizing the KdV equation about the KdV solitary wave. 
This allows to prove the following statement. 
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Proposition 4.6 (Mielke [26]). There exists Sq > such that for every e, e E (0, eo); spectrum 
of which is a self adjoint operator on with domain consists of a negative simple eigenvalue 
X~ , the simple eigenvalue zero and the remaining of the spectrum is included in [A^, +oo[ for some 

Xe > 0. 

Proof. By using similar arguments as in the proof of Proposition [521 we can first locate the essential 
spectrum of A^. At first, we can write that A^ is a relatively compact perturbation of the operator 
(1 + |(9a;7?£p)~2 where 

and thus, it suffices to study the essential spectrum of Be. The next step is to prove that 

is a relatively compact perturbation of Mq^ = —dxG[0]~^dx which is also well-defined thanks to 

Lemma 14.51 As in the end of the proof of Proposition 14.21 it suffices to prove that 

(4.8) M = (Id + C)Mo 

with C is compact as an operator in B{H^ , H^). Indeed, if this fact is proven, as in the proof of 
Proposition 14.21 we immediately get from this that 

M-^ = Mq^ (Id - (Id + C)"^C) = Mq-^ + /C 

where /C is a compact operator in B{H^, L^). Consequently, B/r is a relatively compact perturbation 
of 

^0 = -P dl + a Id + = + a Id - 

tanh(|D^|) 

and hence we get from Lemma 14.41 that its essential spectrum is contained in [e^, +cxd). 
To prove (|4.8p . we can use ()4.5p . to get 

9-i(G[ry,] - G\^\)d-\ = ( " 9-iGK](r?,Z(sr/„ ^'V)) " {r]e[^ " ^^(sr?,, 5" V)^.^))) ds. 

Note that this formula is meanigful since d~^G\srie\^ G[sr/e]9~"'^ and thus Z{srii;,d~^-) are well 
defined bounded operators on thanks to (j3.3|) in Proposition [3Tj By using (j3.23p in Proposition 
13.51 we can write 

d-^G[s7]e] = d-'\Dx\ + 7^l, G[s7]e]d-^ = d-'\Dx\ + 7^2 

where TZi, TZ2 are bounded operators from to H^~^^. Consequently, as in the proof of Proposition 
14.21 we obtain that 5~^(G[%] — G[0])d~^ = M — Mq is a compact operator in B{H^,H'^~^) and 
hence in B{H^,H^). Since M^^ G B{H'^,H^) is invertible we obtain ([ilS]) . 

For the study of the eigenvalues, we shall just give a sketch of the argument of Mielke [2B] by 
explaining how the problem can be reduced to the study of the KdV problem. We first get that 
zero is an eigenvalue from the differentiation of the equation satisfied by the solitary wave. Let us 
denote by Ss the scaling map Ss{ri){x) = ri{ex). Then S~^{r]){x) = r]{x/e). It turns out that in the 
limit e ^ 0, the operator e^'^S^^A^Se is a zero order perturbation of the operator 

For fixed G M, we have (see Lemma l4.4p the expansion for e near zero : 



which allows to prove that 

(4.9) hin\e-'^S-^AoSe{u)-{-ij3-l/3)dl + l){u)\L2 = 0, ^ueH^ 
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Next, we can write 

and the main point in the proof is to show that 



(4.10) 



Urn 

£^0 



£-^S-^{Ae - AQ)Se + 3 cosh- 



0. 



.2(/3- 1/3)1/2. 

Indeed despite the rather weak hnk between the operators, one can then deduce that for smah e, 
the eigenvalues of e~'^S~^Ai;S£ are smah perturbations of the ones of 

which is the operator that arises when Unearizing the KdV equation about a sohtary wave and 
whose spectrum is very well-known. We refer to |26j p. 2348 for the details. We shall just give the 
proof of (|4.10p which can be easily obtained from some of our previous arguments. Coming back 
to the definition of Ag,, (j4.10p reduces directly to 

\DJ 



(4.11) 



lim 

e->0 



7,M-i(7,-) + 



5*^ + 3 cosh 



2(/?- 1/3)1/2 







tanh(lD^I)- 

(the other terms involved in the definition of A^ tend easily to zero). For that purpose, we write 
the Taylor expansion 



G[r7,](^) = G[Q]{^) + Dr,Gm^) ■ % + r,{^) = A^p + B^, 



where 



To compute M 



A = G[0], r,{^) 



il-t)D^„G[tr]e]ip-{7]e,7]e)dt. 







-1 . 



-dx{A + B) ^dx, we use a Neumann series expansion to get 

+ 00 



d,{A + By^dx = dxA-^dx + Y.i-'^yd.iA-^ByA-'dx 

i=i 

Let us observe that we can write 

dx{A-^BY A-^dx = dxA^i{A~^2BA~^2)...[A~iBA~^2)A~^d.^ 

where {^A^^BA^^^ is repeated j times. Note that dxA~^ and A~2dx are bounded Fourier multi- 
pliers in B{H^, i?'*~2 ) and that by setting B = Bi + rs, we first have 

A-^BiA-^^ = -G[0]'2{r]eG[0]'2^) -dxG[0]''2{r]edxG[0]-'2^) 
thanks to Lemma ll. 11 By using classical commutator estimates, we have 



\A~2B1A~2 



< G.^e' 



Using estimates in the spirit of (j3.3p for the Frechet derivative of G[r/], we also have 



1^ 2r^A 2 



Therefore the Neumann series is well-defined and converges and for e ^ 1 we have the expansion 

\Dx 



-M-\^) 



-{^) - dxG[Q]-^Dr,GmG[Q]-^dx^) ■ lie + Re{^), 



tanh(|Da 

with \\S~^ RgSeWn^^L^ = C'(e^). Next, using Lemma [TTTt we may write 

\Dx\ 



(4.12) 



dxG[0r'D.,G[0]iG[0r'dx^) ■ Ve = -dxiriedxif) 



Tie 



tanh(lD^I) V''tanh(|Z5^.|) 
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After the conjugation with e"^^^ the operator defining the first term in the right hand-side of (|4.12p 
tends to zero as e ^ in B{H^, L^). 

Thanks to [6], the sohtary wave (pe) may be written as 

.2(/3 - 1/3)1/2] +^^^^)' 

ex 



'Pe{x) 



-e^ cosh ^ 



.2(/3- 1/3)1/2, 

Hence the second term in the right hand-side of (j4.12p . conjugated by e"^^^ has the same limit as 



cosh 



.2(/3- 1/3)1/2 Atanh(|ei?^|) 
the commutator tending to zero in B{H^, L^). Next, we have that 



hm 



cosh 



.2(/3- 1/3)1/2 Atanh(leD^I) 
Therefore, we obtain that 

1^x1(7.-) 



hm 



e''5-i(-7.M-n7e-) + 7e 



^tanh(lD^I) 
and thus (j4.1ip would be a consequence of 



cosh 



Se + cosh 



2(;g- 1/3)1/2 



2(/3- 1/3)1/2 



0. 



(4.13) hm 

e— >0 



6-25-1 ( 



+ 



tanh(lD^I) tanh(lD^I) 
Coming back to the definition of 7e, we obtain that 



Se + 2 cosh 



2(/3- 1/3)1/2 



0. 



(4.14) 



7£ = 1 -I- cosh 2 



ex 



.2(/3 -1/3)1/2 J 
in Ty^'°°(R), s > 0. Now, (ITO]) fohows from (gUD. 



□ 



Remark 4.7 (Fixing the value of e). From now on, e will be fixed in the range of validity of 
Proposition \4-6\ Proposition \4-^ and Theorem More precisely, from now on we fix an e such 
that e G (0, eo]? where is determined by Proposition \4-6[ Proposition \4.S\ and Theorem M.SX 

Let us define r/" and rf^ as the normahzed eigenvalues of A^, i.e. such that 

(4.15) A,777 = A-7?7, A,7?o = 0. 

Since is a self adjoint operator, we get from Proposition 14.61 that there exists > such that 

(4.16) (^,7?,7?) > CeHl,, Vr? G H\R), {r],rj;) = 0, {t],^) = 0. 
Indeed, Proposition 14.61 vields the weaker bound 

(4.17) {Ae7],r])>cMh, yv^H\R), (r?, r/^) = 0, (t?, 1?°) = 0. 
But using that 

we obtain that 

(4.18) {Aei^,v)>ce{\v\li-C\v\l2), Vr7Gi/i(]R), (ry, r/D = 0, (7?, 7?°) = 0. 

A combination of (|4.17p and (j4.18p gives (j4.16p . Thanks to Proposition 14.61 we get the following 
crucial property of L{k). 
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Proposition 4.8. The operator L{0) has a unique simple negative eigenvalue and for every k, L{k) 
has at most one simple negative eigenvalue. Moreover, for every e £ (0, eo)? there exists c > such 
that for every k, we have that 

\k\' 



(4.19) 



{L{k)U,U) > c |C/i|^i + 



I + LDJ2 



L2 1 + 



F2I 



L2 



for every U such that 
(4.20) 



iUi,ri~)=0, ([/i,?7°) = 0. 



Note that the estimate (I4.19P is uniform for k G [0, +oo[. In some part of the paper, we shall 
only need a weaker estimate uniform for k G [0, K] for some K > fixed. In this case, we can 
deduce from ()4.19p that for every U which satisfies (I4.20p we have 



(4.21) 



{L{k)U,U) > ci(\Ui\jj, + 



] 7^'^'^ 

1 + \D^\^ 



L2 



+ \k\'\U2\i2), yk,\k\<K, 



where ci > depends on K. 



Proof of Proposition \4-8\ We shall first prove the estimate (|4.19p . At first, we notice that it suffices 
to prove that the weaker estimate 



), Vi7, (C/i,r/-)=0, (f/i,r/0) = 



(4.22) {mU,U) > c(\Ui\l, + ' . U2 

holds and to combine it with a crude estimate to get the result. Indeed, let us use that 

(4.23) {L{k)U, U) > m{Ge,kU2, U2) - M\U^\l, - 2| {d^{iv, - l)Ui), U2) 

where m > and Af > are harmless numbers independent of k which will change from line to 
line. To estimate the last term, we use that 



\{d^{{Ve-l)U{),U2)\ < \d.U2\^^i\iv,-l)Ui 

< M 



I A. 



1 < M 

— I 



l + \DJ-2 



tU2\l2 \iVe - '^)Ul\ffi 



< M 



l + \D.^\^ 
\D 



r^2|^2 + \Ve — 1|m/1,oo|C^i|^i 



Consequently, we get from (|4.23p that 



L2 



{L{k)U,U) >m{Ge,kU2,U2)-M(\Ul\j,^ + 



-U2' 



1 + |-Dx|5 

Next, we can add (j4.22p times a large constant and the last estimate to get 



L2 



{L{k)U,U) > m(\Ui\j^i + 



Finally, we can use (j3.4p . which gives in particular that 



-U2 



L2 



+ {Gs,kU2,U2)). 



k\ 



{G,,kU2,U2)>r^^\U2\h 



to get KW\ . assuming K22h . 
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It remains to prove that (j4.22p holds. Thanks to the monotonicity of Gs^k with respect to k 
proven in Proposition 13.11 ii) and since we also obviously have 

{-PsmUuUi) > {-Pe,k,Ui,Ui), \ki\ >\k2\, 

we get in particular that 

(4.24) {L{k)U,U) > {L{0)U,U), yU^H^xH^. 
Next, thanks to (j4.6p . we have 

(4.25) {L{0)U,U) = {AeUuUi) + (^M{d,U2 - M-\-feUi)^,d.,U2 - M-\-feUi)y 

Consequently, we can use the assumption that 

(C/i,r/-) = 0, (C/i,r/0) = 
and hence ()4.16p and the coercivity of Q in Lemma 14.51 to get 



{L{k)U,U) > c(|[/i|^i + d,U2 - M~\-feUi) 



1 



for some c > (c actually depends on e but we do not care on this dependence here and thus we 
omit it in our notations). The expansion of the second term and the Cauchy-Schwarz inequality 
give 



d^U2 - M-\j,Ui) > \d,U2t_i + \M-\^,Ui)\l_i - 2\d,U: 



Consequently, by using the inequality 



(4.26) 

we get 



2ab < 5a^ + 



Va, 6 > 0, VJ > 0, 



\M-\-f,Ui) 



1 . 



d^U2 - M-\^eUl) \ > (1 - 6)\d.,U2t_i - (t - 1) \M-\^eUl)\l. 



where 6 < 1 will be chosen carefully later. Next, since M^^ G B{H^ , H~2^ and 7^ G we can 

use the crude estimate 

|M-i(7,[/i)|^_i < C|7.C/i|^i < C\jeUi\m < C\Ui\hi 



for some C > 0. This yields 
and hence we find that 



\>{i-5)m2\l-^,-c{]-i)\u,\i. 



{mu,u) > c( (1 - C(- - l))|C/i|ii + (1 - 6)\dMl^^)- 



To conclude, it suffices to choose 6 in the non-empty interval {j^, 1) thus for example 

6 



This proves (|4.22p which in turn implies (j4.19p . 

Next, we shall prove that for every k, L[k) has at most one simple negative eigenvalue. Thanks 
to Proposition 14.61 we notice that the quadratic form {-^A^-) is nonnegative on (ry")-*-. Thanks 
to (|4.24p . (j4.25p and Lemma l4.5t this yields that the quadratic form (L(/c)-,-) is nonnegative on 
(?/~, 0)-*-. By contradiction, we obtain that L{k) has at most one simple negative eigenvalue. Indeed, 
otherwise L[k) would have an invariant subspace at least two-dimensional on which the quadratic 
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form {L(k)-, •) is strictly negative. Since this subspace must meet (r/~, 0)^ in a non-trivial way, this 
yields a contradiction. 

Now, we shall prove that a negative eigenvalue of L{0) indeed exists. Since L{0) is self-adjoint 
with essential spectrum included in [0, -|-oo[ thanks to Proposition STJl it suffices to prove that there 
exists U such that (L(O)C/, U) < 0. In view of (j4.25p . a good candidate would be ?7 = {Ui, U2) such 
that 

Ui=rj-, d^U2 = M~\jeUi). 

Nevertheless, the second equation above does not necessarily have a solution U2 in L^. To fix this 
difficulty we shall define a sequence U"^ = {Ui,U2) in and prove that {L(0)U"',U^) becomes 
negative for n sufficiently large. We set 

where x is a smooth bounded function such that xiO = on (—1/2, 1/2) and xiO = 1 ^^r > 1. 
Next, thanks to Lemma 14.51 we notice that 



|2 



<C \{x{nD^)-l)M~\^,r^~)\'^_. 

and hence, since M~^(ji;rj~) G H~2^ we get from the dominated convergence theorem that 

Jim (m(9,C/2" - M-i(7eC/r)) , d^U^ - M-i(7,[/n) = 0. 

Consequently, thanks to (j4.25p . we get that {L{0)U^,U^) is negative for n sufficiently large. This 
ends the proof of Proposition 14.81 □ 



5. Study of the linearized about the solitary wave operator JL{k). Transverse 

LINEAR INSTABILITY. 

As in [32], we shall say that the linearized equation (j2.ip or equivalently (j2.3p has an unstable 
eigenmode with transverse frequency k and amplification parameter a with Re cr > if there is a 
non-trivial solution of 

(5.1) dtV = JLV 
under the form 

(5.2) V{t,x,y)=e''^e'''yU{x) 

with U G H'^ X H^. This provides a non-trivial solution of (j2.ip via ()2.7|) . By substitution of the 
ansatz (|5.2p in the equation (j5.ip . we get the resolvent equation 

(5.3) aU = JL{k)U. 

Note that if there is a solution U G H^^^ x , we find from the first equation of the system 
that fcC/2 G thus since G^^^ is a first order elliptic operator (see Corollarv 13. 6p . we get that 
U2 G H^^^. Next, the second equation gives that Pe.kUi G H'^ and hence since Pg^k is a second 
order elliptic operator, we get that Ui G H^'^'^ . Consequently, one can get by induction that an 
unstable eigenmode U is necessarily smooth, U G H°° x H°° . 
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5.1. Location of unstable eigenmodes. We start with a Lemma which gives a crucial prelimi- 
nary information on the possible solutions of (j5.3p . 



Lemma 5.1. For every e S (0, Eq)) ^'(•^-^(O)) C zM. Moreover, for every k ^ 0, JL{k) has at most 
one unstable eigenmode which is necessarily simple. Finally, if < I5.^) has an unstable mode with 
amplification parameter a then cr S M. 

Proof. The first part is a direct consequence of the one-dimensional stability result of Mielke |26j . 
For the second part, we follow Pego-Weinstein [29] . Suppose that there exist linearly independent ui 
and U2 such that JL{k)uj = ctjUj, Re(a"j) > 0, j = 1,2. Set Vj{t) = e°"^*Uj. Thus dtVj = JL{k)vj. 
Next we observe that thanks to the symmetry of L{k) and the skew-symmetry of J, we have 
dt{L{k)vi{t),V2{t)) = 0. This implies that for every real t, e*('^i+^)(L(fc)Mi, U2) = {L{k)ui,U2). 
Using that Re((7j) > 0, we obtain that {L{k)ui,U2) = 0. Since we know that L{k) has at most 
one negative direction, we obtain that there exists a complex number 7 such that {L{k){ui + 
'yu2),ui + JU2) > 0. Therefore {L{k)ui,ui) + \^\'^{L{k)u2,U2) > 0. By taking the scalar product 
of JL{k)uj = CFjUj by L{k)uj and taking the real part, we obtain that {L{k)uj ,Uj) = 0. Therefore 
U1+JU2 is in the kernel of L(k). This in turn implies that aiUi+'ya2U2 = which is a contradiction. 
Next we can show similarly that an unstable eigenvalue can not be of multiplicity higher than 1. 
Indeed, if we suppose that ui and U2 are such that JL{k)ui = aui and JL{k)u2 = au2 + ui then we 
may consider vi and V2 defined as vi{t) = e"^ui, V2{t) = e"^{u2 + tui) and obtain a contradiction 
as above. Finally, we observe that if (j5.3p has a nontrivial solution for some a and k, then by 
taking the complex conjugate, we obtain that (j5.3p has a nontrivial solution with the same k and 
a replaced by a. If a is not real this contradicts the previous analysis which showed that for each 
k there is at most one a such that (j5.3p has a nontrivial solution. This completes the proof of 
Lemma |5. 11 □ 

In the next lemma, we give a further localization where unstable eigenmodes must be sought. 
We have the following statement giving further information on the location of the possible unstable 
eigenmodes. 

Proposition 5.2 (Location of unstable eigenmodes). We have the following information on the 
location of unstable eigenmodes: 

i) There exists > such that if\k\ > K then there is no unstable eigenmode with transverse 
frequency k and amplification parameter a satisfying Re{a) > 0. 

ii) There exists M > such that for every k , \k\ < K , there is no unstable eigenmode with 
transverse frequency k and with amplification parameter a satisfying Re{a) > M . 

Proof of Proposition \5.SX By taking the scalar product of (j5.3p by L{k)U and then taking the real 
part, we get that 



where c > 0, C > are independent of k. Thanks to (j3.4p . for k large (actually A; > 1 is sufficient). 



Re{a){L{k)U,U) = 



and hence if Re o" > 0, this yields 

(5.4) {L{k)U,U)=0. 
Next, we get by a very crude estimate that 



{L{k)U,U) > c\Ui\l^ + k^\Ui\l, + {G,,kU2,U2) - C{\Ui\hi \U2\ + \U1\I2) 



we have 
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Consequently, we obtain 



+ \k\\U2\l2)-C{\U,\Hi\U2\L^ + \Ui\l,) 



(5.5) {L{k)U,U)>c(\Ui\jj^+e\Ui\i2+ — —u 

and hence, thanks to a new use of (|4.26p . we easily get that for k sufficiently large 

(5.6) {L{k)U,U)>c(\Ui\l^ + \U2\^ 

In particular, we get from (j5.4p that U = 0. This proves i). 

We turn to the proof of ii). We use a decomposition of L{k) under the form 

(5.7) L{k) = Lo{k) + Li, 
where 



1 



(5.8) 



Lo(fc) 







Li 



-d^iiVe - !)■) 



Note that Lq is a real-symmetric operator. By taking the scalar product of (|5.3p with Lo{k)U, we 
find 

(5.9) Re{a){Lo{k)U,U) = Re {JLiU, Lo{k)U) . 

By using an integration by parts and (13. 4p . we get that 



(5.10) 



{Lo{k)U,U) > c[\Ui\j,^ + 



L2 



+ \k\'\U2\l. 



1 + \D^\2 

for some c > 0. To estimate the right-hand side of ()5.9p . we need to estimate the following 
quantities: 

I=\Re{{Ve-l){d.,Ze)Ui,Ge,kU2)\, 

II =\Re{ve-l)d^U2,Ge,kU2)\, 

III = |Re ( - d.,{{v, - l)Ui), {Pe,k + a)Ui)\. 
The term / is easy to bound, it suffices to use (jS.Sp to get 



I<C\Ui\hi 



-U2 



L2 



+ \k\\U2\L2). 



1 + |Z).|2 

The estimate of // follows from the commutator estimate of Proposition 13.81 which yields 



IKC 



1 + \DM 



^U2 



L2 



+ \k?\U2\h 



Finally, by using integration by parts, we also easily get that 

ni<c\Ui\]j,. 

We have thus proven that 



(5.11) 



[jLiU,LQ{k)U) \ <C[\Ui\]j,+ 



l + \DJ2 



-U2 



L2 



+ \k?\U2\l^ 



Consequently, we obtain from (|5.9p . (|5.1Up that 



cRe(a) + 



1 + lDx 2 



^U2 



L2 



1 + -Dx 2 



-U2 



+ 



\u, 



2Il2 



for some constant C > 0, depending on K but independent of a. This yields that [7 = if Re (cr) 
is sufficiently large. This proves ii). This completes the proof of Proposition 15.21 □ 
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5.2. Existence of an unstable eigenmode. 



Theorem 5.3 (Linear instability). There exists cr > and k ^ and a nontrivial U £ x 
such that 

JL{k)U = aU. 

To prove the existence of an unstable eigenmode, we shall follow the general method presented 
in [32] . Note that this result was proven in [18] by using a different formulation of the water waves 
equations. 

Proof of TheoremlSIM Let us set M{k) = JL{k)J. Note that 

(5.12) {M{k)u,u) = -{L{k)Ju,Ju), yu€ H^{R) X H^R). 

Moreover, since J is invertible matrix, we get from Proposition 14.81 that there exists A > and 
v,w e X Hi such that M(0)v = \v, M{fS)w = and that for some c > 



(5.13) {M{Q)z,z) <-c(\zi\]j,+ 1 ^2'), Vz = (zi,Z2), {z,v)=Q,{z,w)=Q. 

Next we set 

f{k)= sup (M(A:)z,z). 

Since (M(0)f,v) > 0, we already know that /(O) > 0. Moreover, from Proposition 13.11 ii) and the 
obvious monotonicity of P^^k^ we get that M(k) is strictly decreasing in k on M4. as a symmetric 
operator. In particular, this yields that f{k) is decreasing on By using (|5.12|) and (|5.6|) . we 
obtain that for k ^ 1 one has f{k) < 0. Therefore, since / is continuous, there exists a smallest 
/cq > such that fiko) = 0. The following lemma is the key element in the proof of the existence 
of an unstable mode. 

Lemma 5.4. There exists ki € (0, fco] such that dim(Ker(M(A;i)) = 1. Moreover, for every F G 
X LP' orthogonal to Ker(M(fci)) there exists a unique v G x orthogonal to Ker(M(fci)) 
such that M{ki)v = F. 

Proof. Thanks to Proposition 14.21 we already know that the essential spectrum of M (k) is in M_ 
and for 7^ it is even included in (— 00, — m) for some m > 0. Indeed, we have 

M{k) = -JL{k)J~^. 

Thanks to the classical variational characterization of the largest eigenvalue, and since / is 
strictly decreasing, we get that for k G (0, k^), the largest eigenvalue of M{k) is positive. Moreover, 
thanks to Proposition 14.81 we further obtain that there is exactly one positive eigenvalue of M[k) 
for k G (0, A;o). Indeed, if there were at least two positive eigenvalues of M[k) for some positive 
A:, we would get by the monotonicity of M{k) that M(0) is positive on a subspace of dimension at 
least two and this contradicts the fact that L(0) has a unique simple negative eigenvalue. 

If for some k G (0,A;o) the kernel of M[k) is non-trivial then, the value ki that we are looking 
for is this k. If for every k G (0, /cq), the kernel of M{k) is trivial then we have ki = k^. Indeed, by 
definition of k^, the kernel of M{ko) is non-trivial and by the classical variational characterization 
of eigenvalues, is the largest eigenvalue of M(/co). Moreover, this eigenvalue is simple. Indeed, 
for < A; < /cq, we have that M{k) is strictly negative on a subspace of codimension 1 (this is a 
consequence of the fact that the kernel of M[k) is assumed to be trivial for k < ko and of the fact 
that M{k) has a unique positive eigenvalue for fc, < /c < fco)- Consequently, by monotonicity, we 
get that M(/co) is also strictly negative on a subspace of codimension 1. Consequently, it cannot 
vanish on a subspace of dimension at least two. 

34 



2 



The second part in the statement of the lemma is a consequence of the fact that M(ki) is 
symmetric and Fredholm index zero. Indeed, is not in the essential spectrum of M{ki) thanks to 
Theorem 14.21 since ki ^ 0. This completes the proof of Lemma |5.4[ □ 



We next finish the proof of Theorem 15.31 i.e. we prove the existence of an unstable mode. Since 
J is invertible, it is equivalent to prove that there exist /c 7^ 0, c > and u G x different 
from zero such that 

M{k)u = aJu. 

Let ki be the number defined in Lemma 15.41 with corresponding kernel spanned by u. We need to 
solve F{v,k,a) = 0, with o" > 0, where F{v,k,a) = M(k)v — aJv. We have that /ci,0) = 0. 
We look for v as v = u + where 

w = {v e H"^ X : {v, u) = 0}. 

Therefore we need to solve G{w, k,a) =0 with a > 0, where 

G{w, k, a) = M{k)u + M{k)w - aJu - aJw, w £ . 

We have that 

r d 1 

u + M{ki)w. 



D,^kG{0,ki,0)[w, fi] = fi[—M{k) 



k=ki 



By, using Lemma 15.41 we shall obtain that D^ f^G{0, ki,0) is a bijection form li-* 
we establish that 

-^M(A;)1 u,u] < 0. 



to L2 X L2 if 



dk 



k=ki 



By explicit computation, we have 



J 



k=k'\ 



2ki{l + {d^rjef) 




d r~i 
dk^£,k 



J. 



k=ki 



From Proposition 13 . 1 1 ii) . we have that 



d /~i 
dk^£,k 



u,u] < 
k=ki J 



k=k\ 

-2ki 



is a nonnegative operator. Therefore, we obtain 
2 



■"2 



— dx<0 



Indeed, we have from the structure of L{k) that U2 does not vanish identically: assume that U2 
vanishes identically, then M{ki)u = gives that G^^k^ui = and hence from Proposition 13.11 iii). 
we get ui = which is impossible. 

Consequently, we have shown that Dy^i^G^O, ki, 0) is a bijection form n-*- x M to x and we 
can apply the implicit function theorem, in order to complete the proof of Theorem 15.31 □ 



5.3. Essential spectrum of JL{k). 

Proposition 5.5. For e £ (0, eo); the essential spectrum of JL{k) is included in iM, for every k. 

Proof. We can use the most restrictive definition for the essential spectrum i.e. following [20], we 
say that A is not in the essential spectrum if A is an isolated eigenvalue of finite multiplicity. Note 
that since we already know by Lemma |5. II that JL{k) has at most one unstable eigenvalue, it still 
suffices following [20] to prove that X — JL{k) is Fredholm with zero index for Re(A) 7^ 0. Moreover, 
the case /c = is already given by Lemma |5.H consequently, it suffices to consider the case k ^ 
only. We shall proceed in a similar way as in the proof of Proposition 14.21 Since we are in the case 
k ^ 0, we can use the decomposition (j4.4p for 7 = 0. This yields 

L{k) = AiA2{k)U{k)B2{k)Bi+K: 
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where, using the notation 

A2{k) = ^2(0, k), B2{k) = ^2(0, k), U{k) = L4(0, k) 

we have that Ai, A2, Bi, B2 are bounded invertible operators and that /C is a relatively compact 
perturbation. We thus have 

A - JL{k) = A - JAiA2{k)Li{k)B2{k)Bi + K 

where K is a. relatively compact perturbation. Next, we can write that 

A - JL{k) = JAiJ-^ (A - JA2UB2)Bi 

+XJAi{A^^ -ld)J-^ + XJAiJ-^{ld- Bi) +k. 

Since the matrices A'^'^ — Id and Id — Bi have exponentially decreasing coefficients, we find again 
that 

XJAi {A-^^ - Id) + XJAiJ-^ (Id - Bi) 

is a relatively compact perturbation. Consequently, to prove Proposition 15.51 it suffices to prove 
that A — JA2L4B2 is invertible for Re A 7^ 0. 

The operator L4 has been studied in the proof of Proposition 14.21 We have proven that its 
spectrum is included in (0, +00). Since it is moreover a symmetric operator, we obtain that 

(5.14) {UU,U)>c\U\l2, yUeH^xH^ 
for some c > 0. Since by an integration by parts and (j3.4p . we have 

(5.15) {L4U,U) > c\d^Ui\l2 + c\U2\^ 1 -C\Ui\l2, 
we can combine the two estimates (I5.14p . (I5.15P to get 

(5.16) (^4^7,C/) > co(|C/i|^i + |C/2|^i), yUeH^xH^ 

for some cq > 0. Finally, let us notice that A2 and B2 are bounded invertible operators on for 
every s and that B2 = ^2- This implies that the operator L^{k) = A2L4B2 is a symmetric operator 
which satisfies thanks to (j5.16p 

(5.17) (L5C/,C/) > c(|C/i|^i + |C/2|^i), yUeH^xm 

for some c > 0. We shall use this property of L5 to prove that the operator A — JL5 is invertible if 
Re A 7^ 0. For F € x L^, we want to prove that the equation 

(5.18) {X- JL^{k))U = F 

has a unique solution U G x H^. The estimate (j5.17p immediately gives that there is at most 
one solution. Indeed, if 

(A- JL5)[/ = 0, 

by taking the scalar product and the real part with L^U, we find that 

Re (A) {L^U,U) = 

and hence since Re A 7^ 0, we get from (j5.17p that [/ = 0. 

To prove that there exists a solution to (jS.lSp , we shall use a classical approach based on a duality 
argument combined with an a priori bound which is typically used in the context of evolution 
equations. To solve (j5.18p for F G x L^, we look U under the form U = JV and thus we need 
to solve 

AV = J~^F, A = Xld-L^J. 

Since A* = Aid + JL5 , we get 

(5.19) \A^V\Hi^H^,2>c\V\H.^Hy^. 
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Indeed, it suffices to consider {A*V, L^V) and apply (j5.17p . Next, we define T as 
jr = {[/ G ifi X ^1/2 . 3v £ X H^/^, A^iV) = U} . 

Thanks to (j5.19p . is a closed set of x H^/'^ . Indeed, let Un £ J- that converges to some limit 
;7 in X H'^/'^. Then there exists K S if^ x i?^^ g^^j^ ^.j^j^^. jj^ ^ A*{Vn) and thanks to (fST^ 
Vn converges to some limit V in x H^/'^ . In particular A*(V^) converges in x to A*V 
which allows to identify U and A*V , i.e. U = A*V and thus get that U G T. We have thus proven 
that is a closed set of x H^^'^. Now, we define the linear form / : x H^^'^ ^ C as 



{J-^F,V), if UeT with U = A*V, 
0, if [/ G 



Using again (j5.19p and the fact that J- is closed in x H^^"^, we obtain that Z is continuous on 

X i/i and therefore there exists V £ x such that 

1{U) = {V,U), yUeH^xH^/'^. 

UU = A*W with W eH'^ X H'^ then [/ G J^. Therefore 

(Ay,VF) = {V^A'-W) = {J-^F,W), e X . 

Hence AV = J'^F and thus U = JV is a solution of (jS.lSp . Moreover thanks to the elliptic 
regularity U G x H^. This ends the proof of Proposition 15. 5i □ 

As a consequence of the Lyapounov-Schmidt method, Proposition 15.51 and Lemma |5.H we have 
the following statement important for future use: 

Corollary 5.6. For every {ao,kQ), / 0, RetJo > 0, cjo G a{JL{kQ)), the set 

{{a,k),aea{J{L{k))} 

in a vicinity of {ao,kQ) is the graph of an analytic curve k i-^ (^{k) and cr(k) is an eigenvalue of 
JL{k). 

6. Construction of an approximate unstable solution 
Let us write the system (jl.Op . (jl.lOp under the abstract form 
(6.1) dtU = T{U) 

where 



We shall also use the notation Q = (t]s, ipe) for the solitary wave. Following the method of Grenier 
|16j used in our previous works [31] , [32] , the main ingredient in the proof of Theorem 11.41 is the 
construction of an approximate unstable solution of ()6.ip under the form 

M 

(6.2) U = Q + SU", t/" = ^ 

j=0 

To measure the regularity of the approximate solution, we introduce for U = {rj, ip) the "norm" 

\\m\\h= E \\dtd^.9^yU{t,-)\\l2^^^y 

0<a+/3+7<s 

Note that since we shall work in this section with linear problems and very smooth {H°°) solutions 
we do not need for the moment to emphasize some differences in the regularity of each components 
of U. 
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6.1. Construction of U^. In the next proposition we first construct the leading term of the 
approximate solution (j6.2p with a maximal growth rate. 

Proposition 6.1. There exists U^{t,x,y) £ ns>o-E** such that 

(6.3) dtU^ = JAC/° 

and such that there exist an integer m > 1 and (Tq > such that for every s > 

(6.4) - ' , <\\U\t)\\Es<c ' Vt>0. 

Cs{l + t)^ (l+t)2^ 

Moreover (Tq is such that the real part of the amplification parameter of every unstable eigenmode 
of (j6.3p is non bigger than aQ. 

Remark 6.2. As we shall see in the proof, we can choose under the form 

(6.5) U^{t, x,y)= [ e"(^)*e*'=^C/(A:)(x) dk, / = Iq U -/q , 



I 



where /q C (0, oo) is a small interval with left extremity ko ^ such that ctq = cr{kQ) and U{k) is 
an unstable eigenmode with transverse frequency k. 

Proof of Proposition \6.1[ We first recall that solves ()6.3p if and only if 



1 
-Ze 1 



= P = 

solves 

(6.6) dtV° = JLV°. 

Since the matrix P is invertible and does not depend on t, it suffices to construct a solution of 
(j6.6p which satisfies the estimate (j6.4p . The first step is to find the most unstable eigenmode which 
solves 

(6.7) aU = JL{k)U 

i.e., we are looking for the largest a such that a is an eigenvalue of JL{k). Thanks to Theorem 1 5. 3 ^ 
we already know that there exists ko ^ such that JL(ko) has a nontrivial unstable eigenvalue. 
Thanks to Proposition 15.21 we also know that unstable eigenmodes must be sought only for trans- 
verse frequencies k such that k S [0, -fC]. Moreover, for k £ [0,K], we have that the amplification 
parameter a of the possible unstable eigenmodes should be real and satisfy a < M. 

Let us assume that the unstable eigenmode given by Theorem 15.31 is such that a = 6. Thanks 
to the previous remarks, the most unstable eigenmode (i.e. with the largest a) has to be sought in 
the compact set 7^ of M x M defined by 

7^ = {{a,k) : 6/2<a <M, \k\ < K}. 

Moreover, thanks to Corollarv 15.61 the set {{a,k), a > 0, k ^ 0, a £ a{JL{k)} is locally the 
graph of an analytic curve. If we define $7 = 3a, cr > 5/2, a G a{JL{k))^ , we thus get that O 
is a bounded (and non empty) open set of M. One can decompose Q as ft = Umlm where Im are 
disjoint, open and bounded intervals which are the connected components of fi. On each Im the 
above considerations prove that there exists an analytic function k a{k) such that cr(fc) is the 
only eigenvalue of JL{k) in cj > 0. We shall prove next that k i— > cr[k) has a continuous extension 
to Im- Indeed, if kn is a sequence converging to an extremity k of Im-, since a{kn) is bounded 
{a{kn) G TV), then we can extract a subsequence not relabelled such that cr{kn) tends to some a. 
Moreover, we also have a > 6/2, and a G a{JL{K)) since JL{k) depends continuously on k. Thanks 
to Proposition 15.51 is actually an eigenvalue of JL{k) and hence is the only unstable eigenvalue 
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of JL{k), thanks to Lemma lS.li By uniqueness of the Umit, we get that hnifc^^./ce/m '^(^) = ^ 
hence, we can define a continuous function on Finally, we also notice that if dim H 81^' 7^ 0, 
then the continuations must coincide again thanks to the fact that there is at most one unstable 
eigenmode. Consequently, we have actually a well-defined continuous function k — > a{k) on (7 
which is a compact set. This allows to define /cq ^^nd ctq by 

do = cr{ko) = sup{(t(/c), k £ ^1} > 

{ko is not necessarily unique). Note that /cq 7^ thanks to Lemma f5.ll Moreover, <y{k) is an analytic 
function in the vicinity of /cq and hence, there exists m > 2 so that 

(6.8) a'(A;o) = • • • = (fco) = 0, a^™) (fco) / 0. 

Let /q C be an interval containing kQ which does meet zero. For k 6 Iq, let us denote by U{k) 
the unstable mode corresponding to transverse frequency k and amplification parameter a{k). 

Taking /q sufficiently small, one can take a smooth curve k U{k) G H^^ which is continuous 
from Iq to for every s. Indeed, by continuity oi k ^ cr{k), we can choose a disk B{a{kQ),r) C 
{Re 0" > 0} such that for every k G Iq, cr{k) belongs to the interior of the disk. In particular 
on dB{a{ko),r), there is no eigenvalue of JL{k) for k £ Iq and hence thanks to Proposition 15.51 
we get that the resolvent {JL{k) — of JL{k) is well defined for {cr,k) G dB{a{ko),r) x Iq. 
Consequently, the eigenprojection on the only unstable eigenmode with transverse frequency k can 
be written under the form 

P(k) = ^[ {a - JL{k))~^ da. 

JdB{a{ko),r) 

This allows to choose U{k) under the form 

(6.9) Uik) = ^ [ {(T- JL{k)y^U{ko) da. 

2vr« JdB{a{ko),r) 

With this definition, U (k) is non trivial for A; in a vicinity of /cq and depends smoothly on k since 
JL(k) depends analytically on k for k ^ 0. We have that a{k) = a{—k). By the definition (|6.9p . 
we also have U{k) = U{—k). Then we set I = IqU —Iq and 

V°{t, x^y) = e'^^^'^'e'^y U{k) dk, 

where the dependence in x of is in U{k). Note that is real- valued by the choice of /. By the 
Bessel-Parseval identity, we get for every s, a G N that 

mv\t,-)\\l.^^,^ = C j e^'^^'^)' \a{k)\'''^k^^-\dt}U{k)\l,^^^dK 

where C is an harmless number. Recall that o"o = o"(A;o). Thanks to (j6.8p . we can apply the Laplace 
method (see e.g. \12>\ I14j ) and obtain that for every s, a > there exists Cs^a ^ 1 such that for 
every t > 

— , \i e-°* < \\dfV\t,-)\\nsi^^.) < -^^e-o*. 



This completes the proof of Proposition 16.11 
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6.2. Construction of U"'. The aim of this section is to prove the following statement. 
Proposition 6.3. For every M > 0, there exists an expansion 

M+l 

(6.10) = [/o + ^ 5^W, W G C°°(M+, H^im^)), (5 G M 

such that for every j, (0) = and for some Csj we have the estimates 

(6.11) \\U^{t)\\E^ < ^''^',+1 e(j'+^)"°*, Vt > 0. 

(1 + t) — 

Moreover, Q + 5C/" is an approximate solution of (j6.ip in t/ie sense that 

(6.12) at(Q + (5^7'') -.F(Q + 5f/") = i?<'P 
and i/iere exists 5o > such that for every S G (0,5o]; estimate, 

(6.13) WR'^^'mE^ < ^^^^^^eS^'+-'^-'\ 

(1 +t)^^ 

holds for t G [0, T^], where is such that 

e 



Proof of Proposition \6.3[ By using the Taylor expansion of 

M+2 efc 

^(g + su) = HQ) + E i! ^'-^[^l {U,...,U)+ S^'+^RmAU), 

k=l 

we can plug the expansion (j6.10p into the equation (j6.ip and identify the terms in front of each 
power of 6 to get for every j > 1 



j+i -I 

(6.14) dtW - JAW = Y^ Yl -DPT[Q]{U^\...,U^^). 

p=2 0<li,....lp<M ^' 

h+-+lp=j+l~p 

Note that the right hand-side of (I6.14|) involves only the ?7' for I < j — 1- This will allow to 
solve these equations by induction. Moreover, thanks to ()6.5p . the Fourier transform in y of 
is compactly supported. Consequently, it will be possible to solve the equations (|6.14p with the 
Fourier transform of compactly supported in y ( in B{0,R{\j\ + 1)) for example). This remark 
yields the introduction of the following "norms" for functions of x only : 



0<a+l3<s 

with the definition 



Hi . . 

Note that the "semi- norm" x is the "energy norm" which is naturally associated to the 
operator L{k). Note also that it does not give any control on the norm of U2 for A; = 0. In the 

sequel k will range in a compact set containing the origin. Thus we will only pay attention to the 

1 

uniformness of the bounds near A; = and for that purpose turns out to be quite natural. The 
main ingredient towards the proof of Proposition 16.31 will be the following result. 
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Proposition 6.4 (Semi-group bound for JA{k)). Let us fix ^ > ctq (where (Tq is defined in the 
proof of Proposition 1 6. 1] ) . p> and s G N. For every every F{t,x,k), F{-,-,k) G C°° {R; H°° (M.)) 
satisfying uniformly for \k\ < K the estimates 

(6.15) Yl \\drdPF{t,.,k)\\L2<As-^^, Vi>0, 

a+l3<s ^ ' 

if U solves 

(6.16) dtU = JA{k)U + F, C/(0) = 0, 

then there exists Cg depending only on Ag^g^ for some Sq > such that for every k, \k\ < K , 

(6.17) \U{tr)\L^ + \U{tr)\xi<Csj^^—y^, Vt>0. 

Remark 6.5. Notice that in particular (j6.17|) provides bounds of U and its time derivatives in 
usual Sobolev spaces. These bounds will be used in the application of Proposition 16.41 to the proof 
of Proposition 16.31 

Proof of Proposition \6.4\ We shall focus on the proof of the estimate (|6.17p assuming that U is a 
smooth solution of (j6.16p . We shall not detail the proof of the existence of the solution which can 
be obtained in a classical way (for example by using the vanishing viscosity method as in [JJj ) once 
the a priori estimates (j6.17p are established. By using again the change of unknown V = P~^U, it 
is equivalent to study the equation 

(6.18) dtV = JL{k)V + F, 1/(0) = 

with F satisfying the estimates (j6.15p and to prove that V verifies the estimate ()6.17p . We shall 
first ignore the estimate of the norm of V2 and prove the estimate 

■yt 

(6.19) \v{t,-)\xi<Csj:^^, yt>o, yk,\k\<K 

by induction on s. We start with the proof of the estimate for s = 0. 

6.2.1. Proof of (I6.19P for s = 0. By using the Laplace transform, we shall first reduce the proof of 
the estimate to a resolvent estimate. Let us fix T > and introduce G{t, x, k) such that 

G = 0, t<0, G = 0, t>r, G(t,2;,/c) = F(t,x, A;), t G [0,T]. 

We notice that the solution V of 

(6.20) dtV = JL{k)V + G, y(0) = 0, Vt > 
verifies 

(6.21) V{T,x,k) =V{T,x,k), VTG[0,r]. 
Indeed, W = V — V is a solution of 

(6.22) dtW = JL{k)W, W{0) = 0, t G [0, T]. 

By using again the decomposition ()5.7p of L{k), we get the energy estimate 

(6.23) ~{Lo{k)W,W) = Re{JLiW,Lo{k)W), t e [0,T]. 

The right hand side was already estimated in the proof of Proposition 15.21 (see ()5.1ip ). We have 
proven that 

(6.24) \{JLiW,Lo{k)W)\<C\W\lo, 

k 
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where C is a constant independent of t, k, \k\ < K and W E . By using the estimate (j3.4p we 
have also seen in (|5.10p that for some c > 

(6.25) {LoW,W) > c\W\]^o, yk, \k\ < K. 
Next, we can integrate (j6.23p in time and use (|6.24p . (|6.25p to get 

\w{t)\^^o <c [ |VF(s)|2 ds, yt G [o,r]. 

fe Jq k 

By the Gronwall inequahty, we get that |W^(t)|^o vanishes on [0,T]. This imphes that Vl^i=0 on 

[0,T] and then that W2 = on [0, T] by using the second equation of ()6.22p . Consequently, we 
shall study (j6.20p . For some 70 such that 

(6.26) ctq < 70 < 7> 
let us set 

Ty(r,x) = £y(7o + ir), H{t,x) = CG{-io + it), (r,x)eM^ 

where C stands for the Laplace transform in time : 

00 



poo 

Jo 



Since V'(O) = 0, W solves the resolvent equation 

(6.27) {-fo + iT)W - JL{k)W = H{t,-). 

By the choice of 70 in (j6.26p . 70 + ir is not in the spectrum of JL(k) for every k. Consequently, 
W is given by 

W = ((70 + ir)Id - JL{k)) ~^H. 
The next step is to obtain an estimate of W uniform in r. We first provide the bound for large 
values of r (note that here we do not use that 70 > ctq). Here is the precise statement. 

Lemma 6.6. Fix 70 > and A' > 0. There exist M > and C > such that for every |r| > M , 
every 7 > 70 every f = (/i, /2) £ x H2 ^ every \k\ < K if U = (C/i, U2) solves 

(6.28) {-f + iT)U = JL{k)U + f 
then 

\DJ 



(6.29) \Ui\hi + 



I + LDJ2 



^U2 



^^ + \k\\U2\,.<C\f\^,^^. 



Proof of Lemma 1 6. (A We shall use Proposition 14. 8[ Let us set = (7y~,0)*, ^0 = (r/^,0)*, we can 
moreover assume that and are normalized in x L^. Then, every U = {Ui, U2Y G x 
can be written as 

(6.30) U = a<^^+(3^o + U^, ([/^, $_) = 0, (C/^, $0) = 

and thanks to (j4.2ip . we have for some c > 

\DJ . 2 



(6.31) iLik)U^,U^)>c{\U^\ij,+ ' +\knU^\i2), yk,\k\<K. 

Next, \iU = {Ui, U2Y e X is a solution of (lOSl) then 

(6.32) l{L{k)U, U) = Re (/, L{k)U). 
To estimate the right-hand side, we use that 

|(/,L(fc)f/)| < C((|/l|^,l + 1/21^2) + |(/2,G,,fcf/2)| + |(/l, {Ve - l)d.U2)\). 
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Next, by using (j3.3p . and that 
we get that 

|(/2,G,,fcC/2)| + |(/l, {Ve - l)d,,U2)\ < C{\h\Hl + IM^i) 

Consequently, we have shown that 

(6.33) \{f,mU)\ < + |/2|^i)(|C/ibi + 



I + IDJ2 



-U2 



L2 



+ \k\\U2\L^). 



-Uo 



l + \D^\ 



L2 



+ \k\\U2\L'^)- 



Furthermore, using integrations by part and some crude estimates, we can estimate the left hand- 
side of (16.32P as follows 



(6.34) {L{k)U,U) > {L{k)U^,U^)-CM + + {\a\ + \l3\){\U^\L2 + 



l + \D, 



L2 



)) 



for some C > 0. Consequently, we can combine (|6.3ip . (|6.30p with (j6.32p . (|6.34p . (j6.33p to get that 



\D, 



1 + \D, 



L2 



2 Il2 



< 



C[\h\m + \f2\ 



1 + a + 



A use of the inequality ()4.26p yields 



(6.35) 



1 ^2 



^k^\Ui?<C{\f\\ , +|a|2 + |/3|2). 



1 + \D, 

We now take the x scalar product of 

(7 + ir)C/ = JL{k)U + f 

with <!>_ and <I>o to arrive at 

(7 + ir)a = -(^7, L{k)J<^.) + (/, a>_) 

and 

(7 + ir)/3 = -([/, L(A;) J$o) + (/, ^0) • 
By using again (j3.3p and the fact that ^q, are smooth and fixed, we have for i = 0, 



\{U,L{k)J<^i)\<C(\Ui\L2 + 
Therefore, we obtain that 



I + LDJ2 



-U2 



L2 



+ \k\\U2\L^). 



(6.36) (7 + |T|)|a| < C{\Ui\l2 + 

(6.37) (7 + |r|)|/3| < C(|C/iU2 + 



1 1?. 



l + |I)x|2 



-U2 



-U2 



L2 



L2 



+ \k\\U2\L'^ + \f\L2xL^), 
+ 1^1 |f/2|L2 + 1/1^2,^2). 



Combining (|6.35p . (j6.36p and (|6.37p . we obtain that for |t| sufficiently large, depending on K and 
7o, we arrive at the ()6.29p . This completes the proof of Lemma 16.61 □ 
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Using Lemma 16.61 we get 

(6.38) |W^(r,-)lxo < C7|i/(r,-)|^,^^i, Vr, K \r\ > M, \k\ < K. 

Next, we give the argument for |t| < M. Since, on the compact set {A = 70 + ir, |r| < M}, there 
is no spectrum of JL{k) by the choice of 70, we get by the continuous dependence of L(k) in k that 
the resolvent 

7^(r, k) = ((70 + ir)Id - JL{k)) 
is uniformly bounded on [— M, M] x [—K, K] i.e. 

\WiT)\H2^m < C\H{t)\l2^l^, Vr, k, |r| < M, \k\ < K. 
Consequently, we have in particular proven the uniform estimate 

(6.39) \W{t,-)\xo<C\H{t,-)\^^^^,, yT,k, \k\<K. 

By the Bessel-Parseval identity, (j6.2ip and (j6.39p . we get 



e 



2^«*|y(t)|^odi < / e-2^«*|l/(t)|^odt = C / \WiT)\]^odT 

'- I - k /lit k 



and finally thanks to (|6.15|) . we get that there exists C > such that for every T > 0, 
(6.40) e-2^«*|y(t)|^o dt<Cj^ j^^-^ dt<C 



(1+T)2p 

since 70 was fixed such that 7 > 70- 

To finish the proof, we can use an energy estimate for (I6.18p . By using again the decomposition 
(|5.7p . we get the energy estimate 

~^e-^^''\LQ{k)V,V) = e~^'<^^'Re{JLiV,LQ{k)V) -2^oe~^^^^ 
Since, by using an integration by parts and (|3.3p we have 
(6.41) \{F,Lo{k)V)\ < C\F\xo {Lo{k)U,U) < 

a new use of (fOij) . (fOSj) and ([6^5]) gives 



e 



t ft 2(7-70)5 



2^o*|y(i)|^o < C e-'^'^'\V{s)\lkds + C j^^—^,ds. 



Consequently, we can use ()6.40p to get 

e2(7-7o)t 



e 



-270t|y(i)|2 < C 



This ends the proof of (j6.19p for s = 0. 

Remark 6.7. The argument for |r| < M given above is different compared to a similar analysis 
in our previous works |3H I32j . In |3H [32], we use an ODE argument since the linearized about 
a solitary wave equation may be easily reduced to an ODE. For the water waves problem such a 
reduction is not clear. On the other hand, it is not clear to us how to adapt the approach presented 
here to the case of the KP-I type equations, the problem being that the analogue of J for the KP-I 
type equations is dx which makes the counterpart of Proposition 15.51 more difficult to establish. 
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6.2.2. Proof of (j6.19p for s > 1. We shall use the following estimate 



(6.42) <C( . d.J 



+ 

L2 



-f 



1 + \DJ2 



L2 



1 + |Z),|2 

One may obtain (16.420 by analysing separately the low and the high frequencies. For the proof of 
(j6.19p for s > 1, we proceed by induction. Let us assume that (j6.19p is proven for s' < s — 1 i.e. 

■yt 

(6.43) \V{t)\^s> <Cj:^^—^, Vt > 0, VA:, < Vs', s' < s- 1. 

We have to estimate \d^~'^dl.V\xo for i < s. We shall now use an induction on i. For i = 0, since 
the coefficients of L{k) do not depend on time, we get that dfV solves 

{dt-jm){d^v) = d^F. 

Moreover, by using the equation (j6.18p and (j6.15p . we get that at t = 

(6.44) \dtVmH^ < C,j, 

where Cs,i depends only on norms of F at t = 0. Thus, we get in particular that 

W = d^V{t) - d^V{0) 

solves the equation 

dtW - JL{k)W = F, W{0) = 
with a source term F satisfying (|6.15p . By using the result of the previous subsection, we get 

■yt 

\w{t)\xo < c—^—, yt>o 

and hence 

(6.45) |afy(t)|^o <C^^^, \ft>0. 
Now, for j > 1, let us assume that 

(6.46) \drdiv\xo<c^^^^, yi<j-i, yt>o. 

By applying d^~''di to equation (j6.18p . we get the equation 

(6.47) m-'div) = j{L{k)dr^div + [di, m]dr^v) + or^diF 

Thanks to Proposition 13.81 and (|6.42p . we easily get the estimate 

Consequently, thanks to the induction assumption (j6.43p . we get that 

(6.48) \[di,L{k)]drV\L. < c{\drdiV\xo + (Y^)- 

By taking the scalar product and the real part of (j6.47p . against L{k)dl~-' diV + [dl;,L{k)]dl~-'V , 
we get thanks to (|6li]) and ([6:48]) that 

(6.49) i|(ar9^y,L(fc)ara^y) +Re(5iar9^F,[5^,L(fc)]ary) 

/ p27t . . . . . . ... 

^ ^((TTTF ^ \dt~'diF\LAdl-'diV\xo+Ke {drdiF,L{k)drdiV)). 
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Thanks to (j6.33p and (j6.15p . we have 

(6.50) \{dr'diF,L{k)dr'diV)\<C 



Moreover, by using the expression of L{k), we can write 

(6.51) Re {dtd-r'diV, [di, L{k)]dr'V) = Re {dtdr'diV2, [di, G^.d^r^^s) + R, 

where R can be estimated by 



(6.52) \R\ < c{\dr^'di~w,\H. (isr^Fii^.+i + 



+ 



d: 



I + LDJ2 



L2 



Note that to get the last term above, we have used that 



< C 



1+|Z),|2 

while for the first term we used a direct commutator of differential operators estimate. By using 
the induction assumptions (j6.43p . (j6.46p and the inequahty (|6.42p . we get 



\dt-'d^V2\w^i < C 



alt 



+ 



and thus coming back to (j6.52p . we obtain 



(6.53) 



\R\ < C 



-,\dr'diV\^o + 



To estimate the first term in the right-hand side of (j6.5ip . we write 



L2 {l+t)P 

)■ 



I {dtdr'diV2, [di, Gs,k]drv2) I < c dt 



L2 



and hence the induction assumption (j6.43p . (j6.46p and the commutator estimate (j3.30p yield 



(6.54) 



\{dtdr^diV2AdlG,,k]dr^V2)\<C 



=7* 



=27* 



,(l + t)p' t ^ '^fe (l+t)2P. 

Consequently, we can integrate (|6.49p in time and use (I6.44|) , (|6.50p , (I6.51|) , (j6.53p , (I6.54|) to obtain 



(6.55) 



{dl-^diV,L{k)dr'diV){t)<C 



+ 



.(l + t)2P 7o (1 + ^)^ 

A crude bound from below on L{k) gives for some c > 0, C > 0, 

{dt-'div,L{k)dr^div){t) 



\dr'div{T)\^.dr 



L2 



VA;, 



< K 



and hence by the interpolation inequality 

V(5 > 0, 3C{5) > : 
we get by choosing 5 sufficiently small and the induction assumption ()6.43p that 



c I 

2' 
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=27* 



{i + typ' 



Consequently, we can plug this last estimate into (j6.55p to get 

=27* rt 7T 



e27t 



(1 + typ 

for every (5 > 0. Note that we have used the inequality (j4.26p to get the last estimate. By the 
choice 5 < 27, we get from the Gronwall inequality that 

This ends the proof of (j6.19p . 

6.2.3. estimate. To finish the proof of (j6.17p . it remains to estimate the norm of V2 which is 
not given by the estimate (j6.19p for small k. It suffices to use the equation for V2 in (j6.18p which 
gives that 

\V2{t)\L2 <C [ {\dMr)\L2 + mT)\H2 + \F2ir)\L2)dT 

Jo 

and then to use ()6.19p (for s = 1) together with ()6.42p and (I6.15p . to get 

\V2(t)\L2 < C—^-—. 

This ends the proof of Proposition 16. 4i □ 

6.2.4. End of the proof of Proposition \6.3[ We proceed by induction. We have already built ^7*^ in 
Proposition 16. 1[ Fix j > 1 and assume that the are built for I < j — 1. We shall estimate the 
solution of (I6.14P by using Proposition 16.41 Towards this, it suffices to check assumption ()6.15p . 
where the source term is defined by the right hand-side of (|6.14p . Let us denote by S^{t,x,y) 
the right hand side of (j6.14p and by S^{t,x,k) its Fourier transform with respect to y. From 
Proposition 13.91 and the standard product estimates in Sobolev spaces, we get 

\S^{t,;k)\Fs <CY, (\U''\Fs+so*---*\U''\F'+'o){t,k), 
p=2 o<ii,...,ip<]\i 
h+-+lp=j+l-p 

where * stands for the convolution with respect to the k variable and | • If'* is naturally defined as 

\V{t,.)\Fs= Yl \drdSvitr)\LHR)- 

a+P<s 

Consequently, by using repeatedly the Cauchy-Schwarz inequality in the integrations defining the 
convolution, the fact that the C/* are compactly supported in A;, and the Bessel-Plancherel identity, 
we get 

i+i 

(6.56) \S\t,-,k)\F^ <C{R,s,j)Y, \\U''\\Es---\\U'nE^. 

p=2 0<li,...,lp<M 

\-lp=j+l-p 

By the induction assumption, again the Bessel-Plancherel identity and the fact that S^{t,x,k) is 
compactly supported in k, after suitable integrations in k starting from (j6.56p . we finally get 

\\S^mE^<C{R,s,j) ^. 

(1 + 1)^ 
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Consequently, since {j + l)c7o > (Tq, the estimate of ||f^-'(t)||_E;'' follows thanks to Proposition 16.41 
Finally, (|6.13p follows from (j6.1ip and crude estimates in Sobolev spaces applied to \\RM,siU"')\\E'> 
and the other terms involving 5^ with p at least M + 3. This ends the proof of Proposition 16.31 □ 

7. Proof of Theorem 11.41 (the nonlinear analysis) 

Let us set V"" = Q + 5U^ where C/" is the approximate solution given by Proposition 16.31 To 
prove our instability result, we shall prove that we can construct a true solution of (jl.9p . (jl.lOp . 
that we can still consider in its abstract form (jG.ip . up to time ~ log (1/5), under the form 

(7.1) U^ = V'' + U, C/^(0) = T/"(0) = Q + (5C/°(0). 
We therefore need to solve the equation 

(7.2) dtU = TiV + U)- riV) - R^P, t > 0, U{0) = 

and obtain estimates for U. More precisely, we need to prove that the solution of (|7.2p is defined 
on a sufficiently large interval (of size log (1/(5)) of time in order to see the linear instability and 
also to prove that U remains negligible in front of V"". 

The aim of the following is to prove a priori estimates for U suitable for that purpose. These 
estimates rely on the transformation of the system into a quasilinear form. Once these estimates 
are established, the result will follow by a continuation argument as in [16] provided the number M 
of terms in the approximate solution is chosen sufficiently large. The proof is organized as follows: 

- In the next subsection, we introduce useful notations and functional spaces. Then we state the 
key energy estimate. 

- Then in Subsection 17.31 we study the Dirichlet-Neumann operator G[7?" + 7]]ip. We need to 
track carefully the dependence of the estimates with respect to the regularity of the surface. Here 
we need the case that if is in the Sobolev scale, for this part the analysis will be very close to the 
one of [23], but also the case that 99 = is the line solitary wave and thus (p is very smooth but 
not in the Sobolev scale. The technically most subtle estimate is the estimate of D^G[r/" + r/Jc^^ • /i 
in when h is in which is given in Proposition 17.131 

- Next, in Subsection 17.41 we derive a quasilinear form of the system by applying three space-time 
derivatives to the equation. We isolate a principal part of the equation and a lower order part that 
mostly arises from commutators and can be considered as made of semilinear terms. Subsection 17.51 
is devoted to the estimates of these semi-linear terms. 

- The energy estimates (which rely on the Hamiltonian structure of the linearized water-waves 
system) are given in Subsection 17.81 

- Subsection 17.101 is devoted to the conclusion that is the proof of the nonlinear instability. 

- Finally, in Section [HI we briefly explain how we can use our a priori estimates in order to 
rigorously get the local existence of a smooth solution for ()7.2p by using the vanishing viscosity 
method. 

7.1. Notations and functional spaces. Let us first introduce several notations. For o" G M, we 
denote by A°" the Fourier multiplier on 5'(IR^) with symbol (1 -|- ICP)'^''^, C £ I^^- We shah also 
denote by |V| the Fourier multiplier by |^|. For a = {ao, 01,02) G N^, we shall use the notation 

Next, for /c G N, we set 

If II • II is a norm, by ||((9)'''ti|| we denote the sum of || • || norms of all the components of {d)^u 
(if n is a tensor an additional summation over the components of u should be added). A similar 
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convention shall be used for (V)'^n. For /c G N and U{t) = {Ui{t), U2{t)) we define X'' by 

\a\<k 

For t > 0, we define the space Xf of functions defined on [0, t] x M? equipped with the norm 

\\U\\xk = sup \\UiT)\\xk . 

0<T<t 

Next, we define W*"' by 

\Ht)\\y^k = ||a"n(t)||ioo(iR2) = ||(a)''u||i.c(ig2) 

\a\<k 

and for i > 0, we use the notation Wf for the space of functions defined on [0, t] x equipped 
with the norm 

||C/||y^fe = sup \\U{T)\\^k . 
0<T<t 

We shall denote by lj{x) a generic continuous, positive non decreasing function on M"*" with uj > 1. 
This function may change from line to line and in fact may be chosen under the form C(l + |x|)^, 
where may change in each appearance of lo. 

Since we want to construct a solution of (16. ip under the form = U+V"" with V"" = (77", if""), 
we shall use the following convention throughout the section: for a function or an operator g{U), 
we set: 

(7.3) g^=g{U + Vn, 5'^= 5(0 

and thus 

g'-g-=g{U + Vn-9{V''). 

For example, we shall use the notation 

- = Gir]" + r]]ip - G[r]'']ip, - Z" = ZlV + U] - ZlV] 
where Z is defined in Lemma 1 1.1 1 and the abstract equation (|7.2p becomes 

(7.4) dtU = T^ - T"" + 

7.2. Statement of the energy estimate. The aim of this section is to establish an a priori energy 
estimate for a smooth enough solution U of (j7.4p defined on [0, T] and satisfying the constraint 

(7.5) 1- ||r?'^(t)||Loo - ||r/(0||L- >0, VtG[0,r] 
where r] stands for the first component of U . 

Theorem 7.1. Let U{t) a smooth solution of (17. 4p on [0,T] satisfying (17. 5p . Then for m > 2, 
S > 5 and t G [0, T] we have the estimate: 

\\U{t)\\'^m+3 < a;^||i?"^||j^m + 3 + ||^"||yym+S + ||f||j^m+3^ 

X (||i?'^^'||^^„+3 (r(T)||^™+3 + \\R''^{T)\\l^^s)dT). 

Of course we can replace m + 3 by m for m larger than 5 but we decided to keep this form of the 
energy estimate in order to emphasize the fact that we have differentiated three times the system 
to quasilinearize it before performing the energy estimate. 

This estimate is far from being the best one to use in terms of regularity to get well-posedness 
of the Cauchy problem, we are not interested here in this issue since it is not relevant for the proof 
of Theorem 11.41 Indeed, the smoother the involved norms are, the better the instability result is. 

49 



In the following, we shall always assume that U verifies the constraint (j7.5p without making 
explicit reference to it. In a similar way, as soon as a Dirichlet Neumann operator G[(] is involved, 
we always assume that C satisfies 1 — ||C||l°° > without recalling it. 



7.3. Preliminary estimates on the Dirichlet-Neumann operator. In this section, we recall 
some useful properties of the Dirichlet-Neumann operator G[i]]ip. The new points with respect to 
similar estimates in [23], [3] is the introduction of time derivatives in our estimates and the use of 
Schauder elliptic regularity estimates. We need to use this elliptic theory and in some cases combine 
it with the Sobolev regularity theory since the solitary waves do not belong to the usual Sobolev 
spaces on M^. In this section, we absolutely do not aim at giving optimal regularity estimates, we 
just give the one which are sufficient for the proof of Theorem 17. 11 

As in Section [3l the problem will be reduced to elliptic estimates in a flat strip, consequently, 
for this section, it is useful to introduce the following notations. 

For a function u{t, X, z) defined on [0, T] x S where S is the strip x (0, 1), we set 

Moreover, as previously \\{^ x,z)^u\\l'^(s) '^iH stand for the sum of the L'^{S) norm of V^^ti for 
|a| < m (and thus this norm is equivalent to the standard Sobolev norm H^{S) of the strip) while 
\\{D)'^u{t)\\i^2(^g-^ will stand for the sum of the L'^{S) norms of D'^u{t) for \a\ < m. With these 
definitions, we have in particular that 

m m 

(7.6) \\{Dru{t)U2^s) = E IKVx,.)™"'5^n(t)||^.(5) ^ ^ \\d\u{t)\\Hr.-.^sy 

1=0 1=0 

Finally, we also set ||tt(i)llw™{5) = IK-^)'"'"(0IIl°°(5)- 

In this whole subsection the time variable t is only a parameter, we shall therefore omit to write 
down explicitly the dependence on this parameter. 

Let us establish some product estimates which will be of constant use throughout this section. 

Lemma 7.2. For m> 2, \a\ + \(3\ <m, and A; = 0, 1, 2, we have 

WD'^uD^vWn.^s) < C\\{Dru\\H.^s)\\{Drv\\HHS), 
\\D''uDfv\\j,,^S) < C||n||^™+.(5)||(Z?)™t;||^.(5). 



Proof of Lemma 7.2. The second estimate is obvious. Let us prove the first one. We start with 
the case k = 0. From the symmetry of the expression, it suffices to estimate \\D'^uD^v\\i2(^g-^ for 
\oi\ < When a 7^ 0, we can use the Sobolev embedding H^{S) C L'^{S) to get 

\\D^uDf'v\\L2^S) < \\D'^u\\Hi^S)\\D''v\\HiiS) < IK^)'"^IIl2(5) IK^)™HIl2(5), 
since \a\ < \(3\ < m — 1. When a = 0, we just write 

\\uD'^v\\l2(^S) < \ML^{s)\\{Drv\\L2^s) 

and the result follows from the Sobolev embedding ||u||2,oo(5) < C\\{D)"^u\\i^2(^g-j when m > 2. For 
A; = 1, it suffices to use the previous estimate with u and v replaced by Vu and v or u and Vv. 
The case fc = 2 is very simple since H'^{S) is an algebra. This ends the proof of Lemma |7.2[ 

□ 

We are now able to state our first set of estimates on the Dirichlet-Neumann operator which 
will be intensively used in the proof of Theorem 11.41 We start with the estimates in the Sobolev 
framework. 
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Proposition 7.3. Let us set 

a; = 5 + ||r?o|| w™+3(r2)) 



and let m >2. 

Then we have the following estimates: 

• for a = -1/2,1/2,1, 

(7.7) \\{drG[v + m]u\\H^ <uj\\{dru\\H^+i. 

• Forn>l>l, a = -1/2, 1/2, 1, 

(7.8) \\{dr{Di;G[^ + m]u-ihi,--- ,hn))\\H^ 

I n 

<ui\\{dru\\H.+.{j{\\h,\\y,^+,){ n \\{dr^%\\m) 

3=1 j=l+l 

(the first product is defined as 1 if I = and the second product is defined as 1 ifl = n). 

• Finally, we have the following commutator estimate 

(7.9) \WMv + m]]{u)\\^^.<ui\\{dr-^u\\^., V|«| <m. 



Remark 7.4. The estimates that we have stated are the useful ones for the proof of Theorem 7.1 
In particular, the important thing is that the dependence in rj in ui is controlled by \\{d)"^'^'^r]\\fji . 
We shall actually prove some more precise estimates. For example, we shall get that for m > 2, 
\ol\ < m, we have 

(7.10) \\d''{G[v + m]n)\\H^m<^i\\idr^\\H^^H^^) + \^^^^^ 
for a = —1/2, 1/2, 3/2 and also 

(7.11) ||9"A,G[r? + r?o](n) • ^^.^^2) < a;|K9)'"n||^.+i(K2) |K9)'"/i||^.+i(k2) 
fora = -1/2, 1/2. 



Proof of Proposition \ 7. 3\ . We shall split the proof in various Lemmas. 

As in the work by Lannes [2^ an important point is to choose in the optimal way (by using a 
harmonic extension) with respect to the Sobolev regularity the map which flatters the domain. We 
shall denote by 5 the flat strip 5 = x (—1, 0). 

Lemma 7.5. Consider H which can be written as H = rj + rjQ and satisfies 1 — ||7]||^oo — ||?]q||j;^oo > k 
with K>0 and d'^r] G H''{R'^) for \a\ <m,m>2,s> 1/2, i]q G W^{M?). 

Then, there exists a map : 5 — > M such that 0{X,—1) = —1, 0{X,Qi) = H[X) which can be 
decomposed as 

(7.12) = 9i{7])+e2{vo) 
with the estimates 

||(i:')™6'i||^fe(5) < Cm,fc|K9)™?/||^fc_i^j^2^, ||6'2||w'"(5) < Cm{l + ||7?o||w™(R2)); 

moreover there exists k > such that 

(7.13) d,e>K, VXGM^ VzG[0,l]. 

In particular the map {X, z) ^ {X, 9{X, z)) is a diffeomorphism from the strip 5 = x (— 1, 0) to 
{iX,z) G ]R2 X M : -1< z < H{X)}. 
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Remark 7.6. As we shall see in the proof, 9i is linear in rj and 62 affine in r]Q, consequently, because 
of the decomposition (j7.12p we also have the property that DO{H) ■ [hi + /12) = 9i{hi) + (^2(/i2) — -2) 
if hi is in some Sobolev space and /12 G . Moreover, we also deduce that for n > 2, D^O = 0. 



As we shall see below the same idea as in |24j can be used. Our situation is slightly different 
since the surface is made of a Sobolev part and a smooth non-decaying part while the bottom is 
flat. Moreover, we have taken into account the presence of time derivatives. 



Proof of Lemma 1.5. Let Qi be defined on S as the (well-defined) solution of the elliptic problem 

A^i = 0, 0~i(X,-l)=O, ~Bi{X,^)=r]{X). 

Then by standard elliptic regularity Qi G ff'^"^2(]R^) if G and hence since the time is 

only a parameter in the problem, {D)'^9i £ H''{S) if (9)™7? G H'^'^iR^). Observe that the 
dependence of 9i with respect to rj is linear. Next we consider the function 61 defined on S by 
9i{X, z) = (1 + z)9i{X, ez), where e G (0, 1) is a small number to be fixed later. We also consider 
the function ^2 defined on S by 92{X, z) = riQ{X) + (1 + r]o{X))z. Then the map 9 = 9i + 92 satisfies 
the required properties, provided e is small enough. Indeed 

= l + H{X) + €zdAiX,ez) + € [ dJi{X,eC)dC. 



dz9{X, z 

JO 

Therefore for e ^ 1, we can achieve ()7.13p since 1 — |-ff|L°° > k > 0. 

The claimed expression for the Frechet derivatives of 9(H) in Remark 17.61 follows directly from 
the construction. This completes the proof of Lemma 17.51 □ 



Remark 7.7. Let us observe that the map 9 satisfies dx9{X, — 1) = dy9{X, —1) = 0, a fact which 
is useful in integration by parts arguments over S. 

We next express the Dirichlet-Neumann operator in terms of a solution of a PDE defined on 
X (0, 1) with a domain flattened by the map constructed in Lemma 17.51 For u{X) a given 
function on M?, if 0" is defined on the domain 



{iX,z)G 



l<z<H{X) = ijiX)+r]o{X)} 

then we can define a function ■0" on 



and is such that (/>"(X, = u{X) and d,(j)''{X, -1] 

the flat domain S by 

^'"(X, z) = (f{X, 9{X, z)), {X, z) G X [-1, 0] 
and we have that il^^{X, 0) = u{X), dzi/j^iX, —1) = 0. Next, if (j) solves the problem 



(92 + 92 + 9; 



F 



on {-!< z < H{X)} then tP{X, z) = 4>(X, 9{X, z)) solves 

(7.14) divxAaiX, z)Vx,zi^{X, z)) = d,9{X, z)F{X, 9{X, z)) 

on S, where g is defined by 



/ d,9{X,z) -9x0(X,z) 

(7.15) giX,z)= d,9{X,z) -dy9{X,z) 

\-d.9{x,z) -d,9{x,z) 

Note that our notation is slightly different from the one of Section O 
Consequently, if solves 



{X,z) G S. 



0, X eM."^, -l<z<H{X), ^{X,H{X)) =u{X), d,(t>{X,-l) =0 
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then = (j)''{X,e{X,z)) solves 

(7.16) diYxAaiX, z)VxMX, z)) = 0, (x, z) e 5, d^X, -1) = 0, 0) = u{X) . 

We observe (see Remark 17. 7p that if ^ and (j) are smooth enough, decaying at infinity in X and are 
such that (l){X, 0) = and d^tl^iX, -1) = then 

divxA9{X,z)Vx,zHX,z))cl){X,z)dXdz = - [ g{X,z)V xMX,z) -V x,z(t>{X,z)dXdz . 

Js 

Coming back to the definition of the Dirichlet-Neumann operator, using the Green formula and a 
change of variable justified by Lemma 17.51 we can infer the identity 

(7.17) {G[7] + m]{u),v) = r [ g{X,z)Vx,zV{X,z)-VxMX,z)dXdz, 

where v{X,z) is such that v{X,0) = v{X). The identity (j7.17p will be used frequently in the 
sequel. 

Let us denote by P the elliptic operator defined by 

Pip = dwxAaix, z)Vx,zi^{x, z)), 

where 9 is defined by Lemma [7.51 As before, the proof of Proposition 17.31 will follow from the study 
of the elliptic operator P. 

At first, in view of Lemma 17.51 we shall establish a useful decomposition of g with a part which 
has sharp Sobolev regularity and a smooth part. 

Lemma 7.8. There exists a decomposition g = gi + g2 such that we have 

(7.18) \\{Drgi\\HHs) < '^(IK^)"^IIh'^-+^(m2) + ll%llw™+^+i(R2)), m > 2, A; = 0, 1, 2, 

(7.19) \\92\\wHS) ^ ^{\\Vo\\v\;k+i{R2)), V/c. 
Proof of Lemma \7.8\ We set 

/ dz02{x,z) -d^e2{x,z) \ 

g2(X,z)= d,e2iX,z) -dye2{X,z) (X,z)GcS 
\^ -(J^U2[X,z) -dyd2[X,z) dMx,z) / 

and gi = g — g2. The estimate of 52 is an easy consequence of Lemma 17.51 Indeed, note that since 
dz&2 = 1 + we have that 

(7.20) |9^02| > K > 0. 

Next, most of the terms arising in gi can also be estimated by using Lemma 17.51 The nonlinear 
terms can be estimated by using Lemma 17.21 For example, let us estimate 

J 1 _ g.^i 

At first, by using the second estimate of Lemma [72] and (|7.13p . (|7.20p . we get 

Next, we can use the first estimate of Lemma [7.21 to get 
d 9i 

||(^)"'(^-^^)|lHfc(5) - ^(ll^2||w™+'=+i(<S) + \\{D)"^Oi\\Hk+^s))\\{D)"'ei\\Hk+i(^s) 

and the result follows by using Lemma [7.51 The other terms can be handled in a similar way. 
This ends the proof of Lemma 17.81 □ 
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The next step will be to study the elliptic equation Pu = Vx,z • F- We shall make use of the 
following elliptic regularity result. 

Lemma 7.9. For m>2, and F such that (i*3)/z=_i = 0, then the solution of 

(7.21) Pu = Vx,z ■ F, {X, z)eS, u{X, 0) = - 1) = 0, 
satisfies the estimate 

(7.22) \\{Dru\\H,^s) < ^{\\{Dr9i\\m-^iS) + lb2||w™+^-i{5))IK^r^llHfc-i(5), k=l, 2,3. 

Before giving the proof Lemma 17.91 we state a corollary which is our basic tool in the proof of 
Proposition 17. 3[ 

Corollary 7.10. For m>2, and F such that (F^) /z=-i = 0, then the solution of 
Pu = Vx,z-F, iX,z)£S, n(X,0) =a,t/(X,-l) =0 

satisfies the estimate 

\\{Dru\\H.t^S)<^{\\{drv\\^,-^,^^,^ + \M^^^ 2,3. 
Proof of Corollary \7.10 . It suffices to combine Lemma 17.91 and Lemma 17.81 □ 

Proof of Lemma \ 7. ^ We need to estimate ||9|ti||j:/m+fe-i for / G [0, ?ti] where stands for the 
standard Sobolev space in the strip. We shall reason by induction on I. 

When / = 0, the estimate of ||u||j:^m+fc is the usual elliptic regularity estimate (note that thanks 
to Lemma l7.5( the matrix g is positive definite thus P is indeed an elliptic operator). The needed 
estimate was actually established in [24] Theorem 2.9. We thus already have that 

(7.23) ll^ll — '-^(llsi ll/f^+fe-i + ||5'2||w"i+fc-i.oo) ||-F||/^»n+fe-i . 

Now, let us assume that u||j|^m+fe-j is estimated for j <J / — 1. Then, we can apply d[ to ^I7I\\ 
to get the equation 

Pd[u = diVx,z-F-Vx,z • {[di,g]Vx,zu), {X,z) G S, diuiX,0) = 0, d,dlu{X,-l) = 0. 
Consequently, we can use again (17.231) to get that 

(7.24) \\dlu\\fjm+k-i < io{\\gi\\H,rr+k-i + \\g2\\w"-+k-h^){\\diF\\fj„,-i+k-i + \\[dl^ 

To estimate the last term in the right hand side, the only difficulty is to estimate the terms involving 
the commutator with gi. In this case, we need to estimate ||V]^^9'~-'(7i V]^^c^Vx,2ii||_H'fc-i(5) for 
j < I — 1 and |7i| + I72I < m — I. As in the proof of Lemma 17.21 we find 

(7.25) W^lA'^ai '^tA'^xMlm-HS) < C\\{Drgi\\H^^Hs) 

Indeed, when k = 3, this estimate is straightforward since is an algebra. Let us explain the 
proof when k = 1. As in the proof of Lemma 17.21 we can write 

and therefore (I7.25P follows except when j = and 72 = 0. In this case, we just write 

l|Vl\,5i5i Vx,.n||i2(5) < C\\{Drgi\\L2^s) W^x 

and the result follows by Sobolev embedding since m > 2. The proof of ()7.25p when k = 2 follows 
the same lines. 

We can use the induction assumption and (I7.24p . (17.250 to conclude since j < I — 1. This ends 
the proof of Lemma |7.9[ □ 

Let ip'^ be defined as a solution of ()7.16p . We have the following bounds for ip"^. 
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Lemma 7.11. For m > 2, we have the estimate, 



Note that we state here a regularity result for all the derivatives of tp^ whereas in Lemma [3. 3 1 we 
could consider only tangential derivatives and one normal derivative. This difference is important 
in order to get an optimal estimate in terms of the regularity of the surface. 

Proof. We split as ■0" = + i where is defined via its Fourier transform by 

(7.26) n^(C,.) = '"\^5sh|^|'^^ ^(C), eGM^.G(-l,0). 
As in the proof of Lemma \'6.'2\ we get the bound 

(7.27) \\{Dru"\\HHs) < C\\{dru\\^,_.^^^^. 

Since solves P{u^) = —P{u^) with homogeneous boundary conditions, by using Corollarv l7.10^ 
we get 

UDru^Uu^^S) < ^{\\{drv\\^,-^,^^,^ + ll%llw'"+'=(R2))IK^)"^(ffVx,.n^)|lH^-i(5)- 
Next, by using Lemma 17.81 we can write 

\\{Dr{gVx,zu")\\H^-^S) < ||(I))'"(5iVx,.n^)||^,.-i(5) +u;(||r?o|lw'"+OII(^>'"^''llHH5)- 
From Lemma 17.21 we infer 

\\{Dr{giyx,.n^)\U-^S) < \\{Dr9i\U^Hs)\\{Dr^''\\HHsy 
This yields by using (I7.8|) 

and hence Lemma 17.111 follows by combining this estimate with (j7.27p . 

□ 



We are now in position to give the proof of (|7.7p . We first prove it for a = —1/2, 1/2 and 3/2. 
Let us write 

a" = 9/4, j + \(3\ = \a\. 

We need to evaluate the quantity 

||a^'4(G[?? + ??o]n)k. = \\did^^A'^{G[ri + Vo]u)h2. 
By duality, we write for v G 5(M^), 

{did^^A^G[v + vo]n),v) = (-l)l^la^(G[7? + r?oK4A%) 

= {-l)\^\di g{X, z)Vx,.(V'") • Vx,.(4A"v) dXdz 



where v is defined by 

COSh(./l)|.+D2(z+l)) 

(7.28) v(x, y, z) = ^- (v). 

cosh JD'^ + 
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1 \\V\\t2 

2(5)" "-^ 



Since we have by using (j7.27p that 

\\V x,z^~^Al^{s) < C\\v\\l^{m?) , 
we get from Cauchy-Schwarz that 

f A-+hd''{g{X,z)Vx,zr)-^x,zA-^^^dXdz\ < C\\{D)"' {g{X, z)V x,zr)\\ 
J s 

and thus, we can use again Lemma 17.21 and Lemma 17.81 (note that a + 1/2 E N) to get that 
j A-+50°(5(X, z)Vx,zr) ■ Vx,.A"5 V dXdz 

Consequently, we get by using Lemma 17.111 with k = a + 3/2 to get that 
j^A''+"W{g{X,z)Vx,zr) ■ Vx,zA--^^dXdz 

and hence, we find that 

||5°(G[r/ + r/o]n)||^.(K2) < w(||(9)™r/||^.+i(ig2) + ho||^„+.+3 ^j^^^) 



This proves (17.7P for a = —1/2, 1/2 and 3/2 and actuahy the refined version (j7.10p . 

To get the estimate, it suffices to interpolate between the H2 estimate and the H2 estimate. 
More precisely, we define the linear operator A acting on the tensor {d°'u)^a\<m as A{d°'u)ia\<m = 
((?"(G[r? + r/o] '''^))\a\<m' S™*^^ ^^^^ operator maps continuously in and into , it also 
maps continuously in H^. This ends the proof of (j7.7p 

Let us now turn to the proof of the commutator estimate ()7.9p . For v £ H2(]S?), we can write 

(7.29) ([5",G[77 + %]](n),i;) =^5Vx,.(5>"-^^"")-Vx,.vdX(iz 
where v is again defined by (j7.28p . We have that 

(7.30) Pid'^r - V'^"") = [P, = divx,.([5, 9"]Vx,.V'") 

and moreover (9"'0" — -f/;^"" satisfies homogeneous boundary conditions. Multiplying (j7.30p by 
9"^/;" — -i/;^"" and integrating over 5 yields 

||Vx,.(5>" - ^^"")||l2(5) < C\\[g,d^]Vx,zr\\L^S) ■ 

To estimate the commutator, we need to estimate \\d^ gid'^V x,z'4'^\\l^{s) ^'^^ \P\ + \l\ ^ ™' ItI 7^ ™- 
Again, when I7I < m—2, we can use the Sobolev embedding H^{S) C L^{S) while when I7I = m — 1, 
we put V^g in L°°. This yields (since m > 2) 

and hence, we obtain from Lemma 17.81 and Lemma 17.111 that 

\m~l„i,u\\ ^ , ,\\IPi\ra—\„ 
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Consequently, we can use ()7.29p and the above estimates to get from Cauchy-Schwarz that 

\{[d'^,G[v + mm,v)\<i^\\{dy''^'u\\r\\v\ 



This proves (|7.9p by duahty. 

Let us now turn to the proof of the bounds on the Prechet derivative of G[rj + rjolu. We only 
consider the case n = 1, the case n > 1 can be handled by applying a straightforward induction 
argument (see [3] for similar analysis). Moreover, we focus on the case / = which is the most 
interesting one since we need a sharp estimate with respect to the regularity of h in this case. By 
duality, we write for v G and A; = 0, 1 (we shall take k = a + 1/2) 

(a"A^Z?^G[7y + 7/o](^x)-/i,t;) = j^h^d'^igV xAD^n^ ■ h)) -V x,z^ dXdz 

= J1 + J2, 

where v is defined by (j7.28p . Using the Cauchy-Schwarz inequality, we obtain the bound 

Ji < C\\{Dr{g{X,z)VxAD,r ■ /i))llH'^-(5)ll^ll^| • 
For k = 0,1 and m > 2, by using Lemma 17.21 and Lemma 17.81 we find 

\\{Dr{g{X,z)VxAD,r-hmH.^S) < i^{\\{Drgi\\H^ + \\g2\\yvrn+^) \\{Dr{D,r-h)\\H.+.^s) 

(7.31) < u;\\{Dr{D,r ■ h)\\ 

Next, we need to evaluate \\{D)^{Dj^ip'^ • /i)||//fc+i(5). For that purpose, we observe that D^jip^ • h 
solves the problem 

P(L>^V" • h) = -A\v{Dr,g ■ h Vx.^V'") 
on S with homogeneous boundary conditions. Thus, using Corollary 17. 101 we get in particular that 

(7.32) \\{DrDr,r ■ h\\H^.+^^s) < ^ \\{Dr {D,g ■ h Vx^zinWH^isy 
To estimate the right hand side of (j7.32p . we use again Lemma 17.21 we find 

(7.33) \\{Dr{D^9-hVx,zr)\\HHs)1^ IK^r (^r,5 • /i) IK^rVx.^V'llH^CS)- 
Using Lemma 17.111 we get 

(7.34) \\{Dryx,.r\\HHs) < ^ii {oruw^,^.^^^^ . 

In order to finish the estimate for Ji, it remains to evaluate \\{D)'^''D^g ■ h\\fjk(^g-j (we recall that 
in this situation Dr?92 ' h = 0). Coming back to the definition of g in terms of 9 an by using 
Remark 17.61 we get the bound 

(7.35) \\{Dr{D,g-h)\\H.^s)<^\\{drh\\^,^r^^^. 
Combining the above estimates yields the bound 

Ji<c.||(ar^L.,.,^,j|(ar/i||^,,i ll.ll^. . 



This ends the analysis of the contribution of Ji. Let us now turn to the analysis of J2. By using 
again the Cauchy-Schwarz inequality, we obtain 

J2 < C\\{Dr{{D,g{X,z) . h)Vx,zr)\\HHS) Mn^iu^) ' 

Next, by using again Lemma [721 we get 

\\{Dri{D,giX, z) . h)Vx,zr)\\HHs) < C\\{D)"'D,g ■ hW^.^^) IK^)™V'"ll//^+i(5) 
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and then we can conclude the bound of J2 as we did in the analysis of Ji , see ()7.33p , ()7.34p , (j7.35p . 
We have thus proven that 

\id''K^DM\7] + 7]Q](u)-h,v)\<u\\(d)'^u\\ ^,i,^A\{d)'^h\\ k.i,,A\v\\ 1 

IV L / I /ujv / , )\ __||\ / lli^'=+3(R)2 II \ ' ll_ff'=+2(R2) II IIh7(R2) 

From this, we deduce that 

||9"A,G[r? + 7?o](n)./i||^,. <a;|K5)"^n||H<.+i(K)2 WThWu^^.^^^y 

for a = —1/2, 1/2 with a = k — 1/2. This yields the desired estimate for a = —1/2, 1/2 and 
actually the refined version (jT.lip stated in Remark 17. 4i 
It remains to study the case a = 1. Again, we start from 

{d''A{Dr,G[7j + r]o]{u)-h),v) = j^kd''{gV x,z{Dr,r ■ h)) -V x,z^ dXdz 



IS 

Jl + J2. 



We first obtain for Ji that 



(7.36) Jl < C\\Ad''{giX,z)VxADvr-h))\\^i^^^\\Vx,zA~-^ALHs) 

< C\\d'^ig{X,z)VxADvr-hm^-^^^^\HLHR^)- 
To estimate this term, we shall use the following classical lemma about products in Sobolev spaces 
Lemma 7.12. We have the estimates 

(7.37) \\uv\\ 3, , < Cct||u|U<^c;-i Ikll 3, , 

V J II llj^3(5) - '^11 lie- (^) II ll_H'2(5) 

for every a £ (3/2, 2), 

(7.38) ^ 
for \a\ + \P\ < m, m > 2. 

Proof. The first estimate is an easy consequence of the fact that 

(7.39) ||/||^,^, = 11/11!,,,, + UJI^^l^^ivay. 

Indeed, let us first prove that 

as soon as /3 G (1/2, 1). From ()7.39p . the term involving the norm can be easily estimated, for 
the other term, we write 

iiHP.,., < Mii.ii<.w/ '"'"'-:n':r''^ >-.'>-' 



f /■KF)-.(r)r^l„.(y)|^^^,^^,, 

JsJs M ~ ^'1 

58 



The second integral is obviously bounded by ||u||ioc. ||f || i • To estimate the first one, we use that 
\u{Y)-u{Y')\\^^ ^ r \u{Y)-n{YT , f \u{Y) - ujY'r 



\Y-Y'\^ ]\Y-Y'\>i \Y-Yr J\Y-Y'\<i \Y-Y'\^ 



< ||n|||oo + \\u\\'^p 



and hence we find 



Wr)-,„(r)n„(y'£^^^^ 



S JS 



ly _y/|4 



lL2 ll"llc/3- 



This proves ()7.40p . To get (j7.37p . it suffices to use that 

Ikt^ll^l < \\uv\\hi + \\uVx,zv\\^i + \\yx,zuv\\^^ 

and to apply (|7.40p to the second and the third term. 

To prove the second estimate, it suffices to consider the case \a\ < \f3\. When |/3| < m — 1, we 
write since H^{S) is an algebra the crude estimate 

< \\{Dru\\H^ \\{Drv\\m < \\{Dru\\^^ wiorvw^^. 

When \P\ = m and thus |a| = 0, we use (|7.37p to get 

WuD^vW^-s < Mc^ \\{Drv\\^s < \\{Dru\\^s\\{Drv\\^.. 

Note that the last estimate is a consequence of the Sobolev embedding and the fact that m > 2. 
This ends the proof of Lemma 17.121 

□ 

Let us come back to the estimate (|7.36p of Ji. By using ()7.38p . we get 

(7.41) \\d''{g{X,z)VxADvr ■ m^i^^^ 

< C{\\{Drg^\\^,^^^ + \\g2\\^^r^+^s)) \\{DrVxAD,r ■ m^^^^^ 
and thus by using Lemma 17.81 we find 

Ji <ui\\{DrvxADvr ■ hm^^^^^\\vU2^u2) . 

Next, as already observed, we have 

P{Dr,^^ • h) = -Vx,z • {Dr,g • hVx,zV) ■■= Vx,. • H. 
From Corollarv 17.101 we have in particular 

and 

\\{Dr{D,r ■ h)\\HSis) < Amrvw^^^^,^ + \\vo\\^v^+:^R^))\\{DrH\\H.^s)■ 

Consequently, we can interpolate between the two estimates to get 

(7.42) \\{Dr{D,r-h)\\^.^^^<u,\\{DrH\\^.^^. 

Therefore, we infer 

Ji <u\\{DriD,r ■ /i))ii^f (5)Ii^iil2(r2) < ^ii(^)"(^.9 • ^ vx,.v")iu§(5) "^"^^ 

By using (j7.38p in Lemma 17.121 we obtain 

\\{Dr{D,g.hVx^zr)\\^.^^^<\\{Dr{D,g.h)\\^.^^^m^^ 
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Since D,jg ■ h has roughly the regularity of x,zGi{h) (by using the definition of g and Remark I7.6p . 
we find 

\\{Dr[D,g.h)\\^,^^^<u\\{Dre,{h)\\^,^^^< 

where the intermediate estimate comes from a new application of Lemma [7.51 Finally, from Lemma 
I7.1H we get 

m 



Consequently, we can interpolate between the two estimates to get 

(7.43) \\{DrVx,.r\\^-i^s^<^\\{dru\\H^ 

We thus obtain that 

Ji <u;|K9)'"+i/i||Hi(K2)||(arn||^,2(K2)||H|i2( 

By the same kind of argument, we obtain a similar estimate for J2 and therefore, we get 
||a"(G[77 + 77oHl|^,i(M2)<u;||(5)"^+i/i|Ui(M2)|K9ru|U2(M2). 
This completes the proof of Proposition 17. 3i □ 

We shall also need to estimate the Dirichlet-Neumann operator in the case when it acts on a 
smooth function that does not belong to a Sobolev space. 

Proposition 7.13. For every m > and £ (0, 1), we have the estimates 

(7.44) |K5)-Gh + r,o]^x||ci+M(M2)<a;(|Ka)-+\||^i + |Ka)-r?o||c2+.)IK9)"^u||c2+. 
and 

(7.45) \\{dr{D:;G[r^ + r^o]u ■ (/ii, • • • , M) Hc^+m < u;{\\{dr+s\\Hi + \\{drm\y+^) 

Moreover, for n > I > 0, 

(7.46) \\{dr{D^G[v + Vo]n-{h,--- , hn))\\m < io{\\{dr^'r]\\m + \\vo\\w^+s) 

I 



nii^j-ii>v'"+3)( n \\{dr^'h,\\Hi)\\u\\^..+^ 



j=i j=i+i 

(the first product is considered 1 in the case 1 = 0). 

This proposition will be used when basically (r^o, u) is the solitary wave (%, (ps) and thus the way 
the estimates depend on the regularity of these functions is not very important for our purpose. The 
important fact is again that the estimates involve at most the norm || (9)™+^77||j:^i . The estimate 
(j7.46p will be very useful to estimate terms like 

{G[r] + r]e]-G[r]s])(pe= / D^G[r] + sr]s]ipe ■ r] ds 

Jo 

since it gives an estimate of this term as soon as i] is in some Sobolev space. 

Proof of Proposition YTTS . For u G we define by tjj^ the (well-defined) solution of the elliptic 
boundary value problem 

(7.47) d\vx,z{g{X,z)VxMX.z))=Q, (X,z)GcS, 9,^(^,-1) = 0, ^(X,0)=n(X). 
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The existence of (weak) solutions of (j7.47p can be obtained by using the L°° a-priori bound coming 
from the maximum principle (see [15], Chapters 2-6). Observe that thanks to the homogeneous 
boundary condition on z = — 1 the maximum of is necessarily reached on the boundary z = 0. 
One may also obtain the well-posedness of (j7.47p . by Sobolev type arguments. Namely, one may 
approach the problem on S by problems on compact domains where the maximum principle holds, 
get solutions on these domains by the Sobolev theory and then pass to the limit by using the 
uniform L°° estimate. 

The next step is to obtain regularity estimates for This will be a consequence of the following 
elliptic regularity result: 

Lemma 7.14. For m > and fi G (0, 1), the L°° solution of 

Pu = F, {X,z)£S, u{X,0) =0, dzu{X,-l) = 

satisfies the estimate 

\\{Dru\\c2+,^s) < ^iWidy^^SWHHM^) + \\{drvo\y+.iR2))\\{Dy'^F\\c,^s) ■ 

Proof. When no spatial derivatives are involved, we have the following classical Schauder elliptic 
regularity result for u (we refer to [15] for example): 

||n||c2+fe+M(5) < ^{\\9\\c^+k+,^(s)))\\^\\c''+t^(S) 
for every integer k. By an induction on the number of time derivatives involved, we easily deduce 
from this estimate that 

(7.48) |KD)™t.||c2+.(5)<a;(IKZ?)'"5llci+M(5)))ll(^)"i^llcM(5). 
To conclude, we first notice from the definition of g that 

(7.49) mrgiy+ns)) < ^(IK^)"ei|lc^+M(5)) + Wiore^iy^.^s)))- 

From the explicit expression of 02, we obviously have 

(7.50) \\{Dre2\y+.is) < C|Ka)™r?o||c2+M(M2) 

and moreover, by Sobolev embedding and Lemma 17.51 we have for every s > 3/2 

(7.51) \\{Dr^e,\y+,^s) < C\\{Dr9,\\H2+s+,^s) < C\\{drr^\\^,^^^^_.^^^^ < C\\{drv\\HHR^) 

since one can always choose s sufficiently close to 3/2 to have 2 + ;U + s — 1/2 <4. This ends the 
proof of Lemma 17.141 

□ 

We can now estimate ip'^. 
Lemma 7.15. For every m > and ^ G (0, 1), we have the estimate 

\\{Drr\\c^+,^s) < a;(iKa)™+=^r?iui(R2) + \\{drm\y+nm)\\i9r^\y+nm ■ 

Proof. Again we consider the splitting -0" = + , where is defined by (|7.26p . By standard 
properties of Fourier multipliers in Holder spaces, we get 

(7.52) \\{Dru^\\csis)<\\{dru\\cs^^.) 

for every s > which is not an integer. Next, since solves the elliptic equation Pu^ = —Pu^ 
with homogeneous boundary conditions, we get by using Lemma 17.141 that 

\\{Dru^\y+,^S) < u;{\\{dr+^v\\HHR^) + |Ka)™r/o||c^+M(M2))|KD)-P^.^||c.(5). 
Furthermore, since we have 

||(Z))-Pn^||cM(5)<^(IKi^)"5llci+M(5))IK^)"^^^llc^+.(5), 
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we get the claimed estimate by using ([739]), ([730]) . (f73T]) and (f732]) . □ 

After these prehminaries, we can get (j7.44p . Indeed, observe that in terms of ip^, the Dirichlet- 
Neumann operator reads 

(Glv + Vo]u){X) = 0) - Vx9iX, 0) . V^nx, 0) 

with 6{X, 0) = + ?/o- Consequently, we get 

|Ka)'"G[r? + r?o]n||ci+M(M2) < ^(|K5)™^||c2+.(5))IK5)™r||c2+M(5) 

and hence (j7.44p is a consequence of Lemma 17.151 and (|7.50p , (j7.5ip . 

The proof of (j7.45p can be obtained in the same way. This is left to the reader. 

Let us finally give the proof of (j7.46p . We shall only give the proof for n = 1 since the argument 
for n > 1 follows by a direct induction argument and we focus on the case that is in a Sobolev 
space since it is the one for which we really need optimal regularity. The case that h is in an Holder 
space is covered by (j7.45p . 

Coming back to (j7.17p . we obtain 

{d''AlDr,G[ri + rio]iu)-h,v) = ^ S^aI (5 Vx,.(Z?„V'" • /i)) • Vx,.vdX(iz 

+ I a"Ai((A,5 • h)Vx,zr) ■ Vx,z^rdXdz 
= J1 + J2, 

where v is defined by (j7.28p with v S ff^/^. Using the Cauchy-Schwarz inequality, we get 

Ji < CWidrA'HgVxADvr ■ h))h4v\\^i ■ 
Next (see ()7.4ip ). we can write 

WidrxkgVxADvr ■ hML- < u;{\\{dr^\\H2 + ||r?o||w™+3) || (a)™Ai (Vx,.(I),V" • h))\\L2 . 
Recall that Dr^ip^'' ■ h solves the problem 

• h) = -dw{D^g • h Vx,zi^l 
on S with homogeneous boundary conditions. By using (17.421) . we infer 

\\{drAlVxADvr-h)\\L^s)<^i{\\{drv\\^^+\\m\\w-+^^^^^^ 
Using Lemma 17.121 we obtain 

\\{DY'^aI {{D,g ■ hVx,zr)\\LHS) < C\\{Dy''Vx,zr\\c^i^^^^^ 

provided a > 3/2. Coming back to the definition of g, thanks to Lemma 17.51 and Remark 17.61 we 
get 

iii(z)rAf(i),5-/i)iiL^(5) <^((iK5r^ii^i + ii%iiw"..+3) ii(ar+^/.|iHi(M2). 

Next, using Lemma 17.151 with fi = a — 1, we get 

\\{Drvx,zr\\c^is) < cc^(iKa)™+MiHi + \\{drvo\\w--^s)\\{dru\\c2+, . 

Collecting the above bounds, we arrive at 

Ji < u;{\\{dr-^S\\m + |Ka)-r?o||w'"+3)|K5)-+^/i||^i|Ka)-n||c2+.||^||^i . 

The estimate for J2 is very similar and thus will be omitted. This completes the proof of Proposi- 
tion [7]T31 Note that we get a slightly better result than stated. □ 

In our energy estimates, we shall also use the following lemma. 
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Lemma 7.16 (see Proposition 3.4 of [3]). There exists c > such that for every rj G W^'^ {^) 
with 1 — ^ ^ for some 5 > Q we have 

{G[r]]v,v) > c(l + ||77||h^i,oo(k2))-2 — ^TT^ V?; G i75(M2) 



(1 + |V| 



2 



L2(M2) 



and 

[G[ri\v,w) < u;(||7?||vKi,oo(R2))||t;|| 1 |h|| i , ^v, w e 



H3(R2) II iijy^( 

Note that we have given previously the proof of (13. 4p (j3.3p which are very close estimates. 

7.4. Derivation of the quasilinear form. The aim of this subsection is to isolate a principal 
part which behaves as a quasilinear symmetrizable hyperbolic like system and a remainder which 
behaves as a semi-linear term after applying a sufficient amount of derivatives to the equation. Let 
us explain more precisely the strategy. We can consider the water waves system under an abstract 
form 

dtU = j^{u). 

When applying the operator 9", for \a\ to be chosen, to the system, we find 
(7.53) dtd^U = JA[U] ■ d^'U + TZ{U) 

where dt — JA\U] is the linearized equation about U and 1^(17) involves some lower order commu- 
tators. Let us set Ua = d°'U . If we consider only the principal part in the equation for in 
view of the skew symmetry of J and the symmetry of A[C/], one expects to get energy estimates by 
taking the scalar product of the equation with A[U]Ua and then by reiterating the same process 
for higher order derivatives of Ua- The energy norm associated to A[U] will be the norm and 
thus, we expect to control the norm ||C/Q(t)||jffe. 

A good "quasilinear structure" for d°'U which easily yields an energy estimate arises for (j7.53p 

if: 

i) the norm of the remainder ||(9)'^7?.(f7)||xo can be estimated in terms of ||C/||j^fc+|a| when k 
is sufficiently large. In this case, we shall say that this term behaves as a semilinear term; 

ii) the estimate of the commutator [{d)^, JA[U]]V in the energy space involves at most the 
norm ||[/||j5j.fc+|a| when k is sufficiently large. 

If A were a first order operator (this arises classically for the usual quasilinear wave equation 
rewritten as a first order system), by using the above second property, we expect the commutator 
estimate 

\\m\JA[U]]V\\xo<\\U\\x.M^,\\V\\x. 
which allows to get an a priori estimate for U under the form 

\\Umx^-M^\ < r(0)||x^+|.| + r ||f/(r)||^.+|.| dr. 

Jo 

This is a good without loss estimate which can be easily combined with an approximation argument 
(for example the vanishing viscosity method) in order to get a local existence result and to prove 
Theorem 11.41 when considering a perturbation of by using the Gronwall lemma. Note that in 
this situation, there is no need to use time and space derivatives simultaneously. 

As already pointed out in the introduction, in our situation (which is formally close to the one of 
higher order wave equations), in order to close the energy estimate, the commutator [{d)^, JA[U]]V 
cannot be considered as harmless (or semilinear) since its X^ norm involves an X"^ norm of V with 
m > k. Moreover, for the same reason, the term TZ in (I7.53P cannot contain only semi- linear terms. 
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Nevertheless, the above considerations can be generahzed to our framework. The equation for d^U 
can be written under the following more precise form: 

(7.54) dtd^U = j(a[C/] • d"U+Q[U] • (5%)|^|<|,|) +n{U) 

where Q{U)- is a linear operator acting on the tensor (9'^f^)|/3|<|a| which is of lower order than 
A but of too high order to be incorporated in the semilinear terms. We shall prove that A and 
TZ match the above properties i) and ii) for \a\ = 3. The energy estimate for (j7.54p will then be 
obtained by proving that the subprincipal term Q, and the higher order part of the commutators 
[()^,A[C/]] can be incorporated as harmless lower order terms in the energy. For this argument, it 
is important to use space and time derivatives simultaneously. 

7.4.1. Analysis of ()6.ip . Let us first denote hy U = {r], ip) a solution of (j6.ip . We first focus on the 
first equation of (j6.ip which reads 

(7.55) dti] = dxt] + G[r]]ip. 

Let I = {t, X, y}. We first notice that for k £ 2, d^r] solves the equation 

(7.56) dtdkT] = dxdkT] + G[r]]dkip + DG[r]]ip • dkT] 
and thus by using Lemma ll. 11 we find 

(7.57) dtdkV = d.dkV + G{dkyp - ZOkv) - V • (^r/ v), 
where we shall use for short hands throughout this section the notation 

G = GM, v = v[r^,^]=Vip-ZVv, Z = Z[r?, = ^i^^^±^2^ 

(the notation for Z was already introduced in Lemma II. ip . Next, as in [21], we can derive an 
equation for dij^i] for i, j, k £ I by applying two more derivatives to (j7.56p . We find 

(7.58) dtdijkT] = dxdijkT] + Gdijk(p - G{Zdijkri) - V • {vdijkv) + Qi^[r], f] + '^I'^iv, f], 
where 

(7.59) Qf [r/, y^] = Y^ A,G[r?]5,(,),(,)V9 • d^^k)V 

(T 

the sum being taken on the circular permutations a of the set /c} is the subprincipal part of 
the equation which must be handled with some care and is under the form 

(7.60) 7^f [7?, v]=Y. D':,G[riW^ ■ {d^'v, • • • , S'^"^) 
where the sum is taken on indices n G N*, /?j G N'^, 7 G which verify 

(7.61) l<n<3, |/3i| + ... + |/?„| + |7| =3, I7I < 1, 1 < |A| < 3, Vi. 

We shall prove below that this term behaves as a semi-linear term and thus it is not necessary to 
write down a more precise formula for it. 

Let us now study the second equation of ()6.ip . If we apply the operator to the second equation 
of (|6.ip . we get by using the previous notation 

(7.62) dtdkV = d^dkip-v-Vdk'P + ZGdkV + ZD,^G^-dkV + Zv-VdkV + P'^-{A{Vri)Vdkv)-adkV, 
where the matrix ^(V^) is given by 

My) = r 3-- 

(l + |y|2)2 (l + |y|2)2 
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We now find that dijkf solves 

(7.63) dtdijkip = dxdijk^ - v ■ Vdijk^p + ZG{dijk'f - Zdijkf]) - Z(V • v)dijk'n 

where 

(7.64) Qf[v,V^] = • {DAiVij) ■ (a.(.)Vr?,5.(,y(,)Vr/)^ 

the sum being taken on the circular permutations of {i, j, k} and 

(7.65) nf[r],ip] = -[d^j,v]-Vdkip+[dij,ZG]dkip+[di,,ZDr,G^]-dkV 

+[d,j, Zv] ■ vdkv + /3v • {D^A{V7]) ■ (vdkT], vdjv, va,??)) . 

Again, as we shall see below, TZ^^^ can be considered as a semi-linear term while Q^J^ must be 
handled with care. 

Now, let us set Uijk = {dijkrj, dijk^Y, then (j7.58p . (|7.63p can be written under the abstract form 

(7.66) dtU,,k = J{A[r], ^]U,,k + Q''%, ^]) + ^] 

where Tl^^''[ri,ip] = {TZY''[r],ip],TtJ''[r],(p]y, Q^^''[r],(p] = {-Q^-^'^[ri, tp], QY^It], tplY and A[r],ip] is the 
linearized about (r/, ip) operator. Namely 

-PV ■ (^(V??)V • ) + a + ZG{Z ■)+ZV -v vV -d.^-ZG 
-V ■{v)-G[Z-)+d^ G 

where Z = Z[ri, ip], G = G[r]], v = v[i], p]. 

By using Proposition 17.31 (with r]"" = ip'^ = for the moment), a lengthy but straightforward 
computation shows that for k sufficiently large, we have the estimate 

which indicates that we can consider TZ^i^ as a semi-linear term. We shall not prove this estimate 
now since we need to work in a more general framework where U is taken as a perturbation of V"" 
which is not in H^. In the next section we describe the structure of this problem. The more general 
estimate that we shall prove below implies the above claimed estimate just by taking = in 
the following estimates. 

7.4.2. Analysis of (f7?2]) . Recall that V°- = {ri°-,p°') = Q + 517°', where U"- is the approximate 
solution given by Proposition 16.31 Coming back to the analysis of (|7.2p , we have that thanks to 
Proposition 16.31 with the notations introduced in the previous section, U^jk = {dij^r], dij^pY solves 

(7.67) dtUi.k = j{A'U,,k + {^'"f - {Q^'^'T) + Q'^'iv. - ^^,kB°'', C/(0) = 0, 
where the claimed semi-linear term is now given by 

(7.68) g^^%,p]=gf[^,p]+gf[r^,p^l 

where 

G'^^[i], ip] = + + - 1^^%°, p^"] = {TV^^f - {TZ'^^T 

and 

[7?, p] = J{A[r, + r,°,p + p-] - A[7?", p^])d,,kV'' = J{A' - A°)di,kV- . 

The terms dijkR"'^ enjoys the bounds provided by Proposition 16.31 It will also be useful to use the 
shorter notation 

(7.69) dtUijk = J{A'U,jk + {Q''")' - {Q''^T) + F,ju , 
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p 



for (j7.67p where 

(7.70) Fijk = G''''[v,^]-d^,kR''''- 

In order to perform our energy estimates, we shall use the canonical form of (|7.69p identified in 
(in the absence of surface tension). We set Wijk = PUijk, where 

1 \ _ / 1 

-ZiU + V] I J ~ \ -z^ 1 

We find that Wijk solves the problem 

(7.71) dtWijk = J{L'Wijk - JPJ{{Q'^')' - (Q'^'^r)) + PF,,k, 
where 

-P(V?y) + {v ■ VZ) + {dt - d,)Z vV-d, 
-V • (v) +d, G 



L[r],ip] 



with Z = Z[r], ip],v = v[r], v?], G = G[r]] and V{Vr]) defined by ^(V?]) = /?V • (A(Vr/)V-) - a. 

7.5. Estimates on the semi-linear terms. In this section we estimate the semilinear term 
Q^^^[r], If] arising in (|7.67p . In the estimate below V"" will be evaluated in >V™'+'^ with S sufficiently 
large since we will make use of Propositions 17.31 and 17.131 Here is the main result of this section. 

Proposition 7.17. For m > 2, and S > 5, we have the estimate 

\\g'^''[r],^p]\\xr^ < t^(||y"||w™+s + ||C/||x-+3)l|t^lLY-+3- 

Since there are many terms that we need to estimate, we shall split the proof of Proposition 17.17] 
in many Propositions and Lemmas. To save place, we shall use the notation 

^m,S = '^(ll^"llw™+S + l|t^llx'"+3)- 

Our first result towards the proof of Proposition 17.171 is: 
Proposition 7.18. For m > 2 and S > 5, we have 

(7.72) \\{dr{inf)' - {nfr)\\^, < uJ^,5||c/||x'"+3. 

Proof. From the definition of TZj''', we have to estimate the norm of terms like 

(5)'^(l»;G''5^(^'^ + (^)- [d^'ir]" + rj),--- ,5^"(r/'' + r?)) - D^G^S^^'^ • (S^^r?'',-- - ,9^"r/'^)) 

where n, 7 and Pi satisfies the constraints ()7.6ip . By multilinearity and symmetry, we need to 
estimate three types of terms: 

h = D'^G^d^^" ■ [d^'T]'', • • • , d^-T]") - D^G'^d'-'ip'' ■ (5^177°, • • • , d^-T]"), 

/2 = D'l^G^d^^ • (5^lr/^ • • • , 5^'r/^ 9^'+ir/, • • • , 
and _ _ _ _ 

with < / < n for /2, < / < 71 — 1 for Is and /3j = for some permutation a of {1 • • • , n}. In 
particular, from (j7.6ip . we have that < 2 and I7I < 1. From the second estimate of Proposition 
17.31 we immediately get that || (c?)™/2||_ffi satisfies the claimed estimate (j7.72p that is 

||(9)™/2||i/i <'^m,s\\U\\x^+3- 

In a similar way, the estimate 



follows from Proposition 17.131 estimate (|7.46p . 
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For the estimate of Ii, we first write 

"1 d 



(7.73) 1^ = 1^^^ [d^GIv'' + • (9^17?^ • • • , 5^-7?'^)) 



ds 





From Proposition 17.131 estimate (|7.46p (with t] being the only function in H^) and (|7.6ip . we thus 
also obtain that 

This ends the proof of Proposition I7.18[ □ 

Remark 7.19. Note that the important point in the proof of Proposition \ 7.1(^ is that i] does not 
appear with more than two derivatives in the directions of the Frechet derivatives of G and that 
ip does not appear with more than two derivatives, i.e. we are in the scope of applicability of 



Propositions 7.3 and Proposition 7.13 



We shall now turn to the estimate of the terms involving TZ^J^. Towards this, we shall use very 
often the following product estimates: 

Proposition 7.20. For m > 2, a = 1/2 or a = 1, we have 

(7.74) \\{dr\uv)\\H^(^R2) < C\\{dru\\H^(^R2)\\{drv\\H^^M^^, 

(7.75) \\{dr\uv)\\H.(^^2) < C|Ka)™u||H.i,oo(K2)|K9)-HlH-(R2)- 

Note that in the second estimate u and v do not play symmetric parts. As in Lemma 17.121 a 
sharper but not needed estimate holds by replacing ||((?)'"ii||yi/i,oo(iR2) with ||(5)'"u||cq for a > 1/2 
when a = 1/2. 

The proof of Proposition 17.201 is very similar to the ones of Lemma 17.21 and Lemma 17.121 and 
hence will be omitted. In the next proposition, we evaluate the contribution of TZ^^''. 

Proposition 7.21. For m > 2, S > 5, we have the estimate 

\\{dr{{nf)'-{nfr)\\^. <zj„,,s\\u\\x^^s 

Proof of Proposition 7.21\ We shall first establish the following lemma. 
Lemma 7.22. For m > 2, S > 5, we have 

(7.76) \\{dr+\v' - v^w^i + \\{dr+\z' - z'^)\\^. < uJm,s\mx-^^ 

and for \ j\ < 2, we also have 

(7.77) \\{^r{^^v'^)\\^^ + \\{^r{^^z'^)\\^^ <iOm,s\\{dr^\\Ht 

Proof. We start with the estimates involving Z. Write Z = Z1 + Z2, where Zi = {l + \\/rj\'^)~^ G[ri]ip. 
A straightforward application of Proposition 17.201 implies that 

(7.78) WiOr^^Z', - ZDII^i < uJm,s\\U\\x-+^ ■ 

We shall not detail the proof of the inequality (j7.78p . Instead we shall estimate in detail the 
contribution of Zi whose proof is very similar and contains additional difficulties coming from the 
presence of the Dirichlet-Neumann operator. Set w[r]] = (1 + IVj/P)""*^. Then we can write 

(7.79) Zf-Zl = {w^ -w'')G''ip'' + uj\G^ -G'')ip'' + w^G^ip. 

To estimate the first term in the decomposition (17.790 . we use Proposition 17.201 to obtain 

(7.80) \\{dr+'{{w' - u;'^)GV'^)||^. < G\\{dr+\w' - w'^)\\^.\\{dr+\G^^'^)\\^^.^ . 
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Next, since 



5 a 
W — W 



|V7? + Vr/"|2 - |V??"p 



(l + |V7?'^|2)(l + |Vr/ + Vr/«'|2) 
we obtain after several applications of Proposition 17.201 that: 

(7.81) \\{dr+\w' - w'^)\\^^ < S7„,5l|C/||x™+3 . 

Since, by using the estimate (|7.44|) of Proposition 17.131 we also have that for S > 5 

\\{dr+\Gm^n\\w^,o.<co{\\v'^\\^^+s) 

we get that 

(7.82) ||(ar+2((u;'5-^«'^)GV)ll^i <uJm,s\\U\\x-+^- 

Next, to estimate the second term in (|7.79|) . we first observe that for every ip smooth enough, the 
bound 

(7.83) \\{dr^'{w'^)\\^. <uJrn,s\\{dr^'i^\\^^, 

holds. Indeed, it suffices to write = {w^ — w"") + w'^ and to use Proposition 17.201 and (j7.8ip . By 
using (|7.83p . we thus obtain 



(7.84) \\{dr+\w\G' - G'^)^n\\^^ < uJmM\{dr^\iG' - • 

To estimate the last above term, we use that for lal = 2 



and we notice that d°' (^DrjG{srj + ri°'\ip°' ■ r/) can be expanded as a sum of terms under the form 

/ D''G[n'' + si]\dl^<^'' ■ {d^^r],d^^hi, ■ ■ ■ ,5^"/in-i) ds 
Jo 

where n > 1, the hi may be r] or ry" and |7j| < 2. Since d'^^r] belongs to the Sobolev scale and 
there is never more than two derivatives of r] involved in the above expression, we can again use 
the estimate (|7.46p of Proposition 17.131 to infer that 

\\{dr^\{G' - G^)^^)\\^. < ^„,5||C/||x'"+3 . 

Coming back to (j7.84p . we have thus proven that 

(7.85) \\{dr-^\w'{G' - G«)^«)||^i < uJmMmx-+^ ■ 

Finally, to estimate the last term in (j7.79p . we first write from another use of (|7.83p that 

\\{dr+\w'G'^)\\^. <uJm.,s\\{dr^'iG'^)\\^. . 

Since for \a\ = 2, we can decompose 3°(G[r/ + r]'^]^p) as a sum of terms of the form 

D:;G[v + rWif{hi,---K) 

with hi = d^'T] or d^^rj"" and I7I < 2, < 2, we can use Proposition 17.31 to obtain 
and therefore, we obtain that 

(7.86) \\{dr+\w'G'^)\\^r < aJ„,5||C/||x™+3. 
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By using the decomposition (j7.79p and the estimates (j7.82p . (j7.85p . (j7.86p . we find that 

\\{dr^Hzi-Z'^)\\^. <^rn,5||f/||x™+3 
which in turn taking into account (17.780 gives 

(7.87) \\{dr+\z' - Z'^)\\^. < Um,s ||f/||x"^+3 . 

This proves the first estimate for Z in Lemma 17.221 Next, since can write for I7I < 2 that 

\\{dr{d^z'i:)\\^^ < \\{^r{^^{z'-zni.)\\^^+\\{^r{^^z'^^p)\\^^, 

by using (j7.87p together with Proposition 17.201 and Proposition 17. 131 (to bound Z"") we also find 

(7.88) \\{dr{d^Z'n\^^ <iOm,s\\{dr^\\^^^ 

and hence the second estimate for Z is proven. 

It remains to prove the claimed estimates for v. Let us recall that vltjjip] = — Z[ri,ip]Vr]. 
Therefore we can write 

-y<^ = \7^- (^{Z^ - Z'')VrC + Z-'Vr?) . 
Consequently, by using (17.87p . (17.88P and Lemma [7.201 we infer 

(7.89) ||(a)-+2(/_^-)||^, <^™,5||f/|U'"+3. 
Finally, we can write that 

and hence, by using (j7.89p together with Proposition 17.201 and Proposition 17.131 (to bound v"'') we 
get the bound 

(7.90) ll(5)"^(9V^)||^. < . 

This ends the proof of Lemma 17.221 □ 

The result of Lemma 17.221 will be one of the main tool when estimating 7^^^'''[y" + [/] - Tl'l^SV^ 
We start by the estimate of the contribution of the following terms in the definition (j7.65p of 7^2"^. 

Lemma 7.23. For S > 5, m > 2, we have the following estimates: 



(7.91) \\{^^{[^^j,V^] . dkVif^ - [dij,v''] . afcVv9")||^i < Um,s ||f/||x™+3, 

(7.92) \\{dr{[d.^,Z'G']{dkip')-[d,,,Z-G-]{dk^'^))\\^i <uJm,s\\U\\x^+3, 

(7.93) \\{dr{[di„Z'v'] . Vdkv' - [^^j.Z%''] . Vafc7?")||^i < urn,sm\xm+^, 

(7.94) \\{dr{[dij,Z^Dr,G^^^] . dkii^ - . dkv") 1 < cJ„.,5||t/||x™+3, 



where we again use the notation u!m,s = ^(ll^"l|yv'"+s + l|f^llx'"+3) . 

Note that v and Z both satisfy the estimates of Lemma 17.221 and that the Dirichlet-Neumann 
operator G acts as a first order operator in space. Consequently, the statements ()7.92p and (j7.9ip 
are formally very close. Since the Dirichlet-Neumann operator which has a nonlinear dependence 
in the surface is much more difficult to deal with than the simple operator V, we shall only focus 
on the proof of (j7.92p . The proof of (j7.9ip which is simpler and follows the same lines is left to the 
reader. In the same way, since because of Lemma 17.221 Zv behaves as v and Z, the proof of (j7.93p 
which is very similar and simpler than the one of ()7.92p is left to the reader. Note that the proof 
of (I7.93P is even simpler since t] is smoother than ip: we are allowed to put it in H^. 
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Proof of Lemma \ 7. 23\ As already explained, we focus on the proof of (|7.92p and (j7.94p . Let us 
start with the proof of (|7.92|) . The commutator [dij, ZG\dk^ can be expanded as a sum of terms 
under the form 

(7.95) I[U] = d^°ZD'^G[7]\dkd^'f ■ [d^'r], • • • , 9^"r/) 
where the indices satisfy the constraints 

(7.96) Vf, < i < n, |7i| < 2, < 1. 

To get (|7.92p . we thus need to estimate ||(9)'"(/'' — /°) ||^i . Towards this, we expand 

-P = [d^»Z^ - 5^"Z'^)L>^G"afc9^(/?" • (a^ir?^ • • • , 9^"r?'') 

+J 

(7.97) = h+h + h + J 
where ^7 is a sum of terms under the form 

Jl = d^^Z^Dl^G^dk^p^ ■ (a^lr?^ • • • , d^'ri", d^'+^T], ■ ■ ■ d^^r]) , 

where the 7^ are obtained from the 7^ by a permutation and / is such that I < n — \. 
By using (f7775]l . (f7^ . (I776|) and the fact that I70I < 2, we obtain 

WrhW^^^ < GWidrD^^G'^Okd^^'^-id^^r,--- ,5^"r?«)||^i,oo||(9r+2(^5_^a)||^, 

< ^m,s\\U\\x"^+3- 

Next, since we have from (|7.77p that 

\\{dr{d""^Z'D^G'dkd''ipid"''r]'',--- ,d"'"rj-))\\^i<oJ^^s\\{dr{D;G'dkd''^id"''7j'',--- ,d"'"v^))\\^i, 
we get by using (17. Sh with / = n that 

\\{dr{D:;G'dkd('y,-{d^^v'',--- <uJ^,5|K9)'"+i9fc5^(^||^i <aJ^,5|K9)'"+Vll^i. 

This yields by using ()7.96p that 

IK5)"^l3||^i <uJ„,5|K5)™+3(/.||^i <uJm,s\\U\\x^+^- 

In a similar way, we can use (j7.77p to get 

WiOrhW^^ < iJm,s\\{dr''{{D';,G' - • • • • , 5^"r?'^)) . 

Therefore, by a new use of the Taylor formula as in ()7.73p and ()7.46p we infer 

IK9)'"/2||^i <0Jm,s\\{dr^^V\\m <uJm,s\\U\\xm+3. 

Finally, to estimate Ji, since f^ = (p + (f°',we can also use successively (|7.77p and ()7.8p for the part 
involving ip or (|7.46p since I < n — 1 for the part involving if"" to get 

widrjiW^i <^™,5iif/iix™+3. 

Consequently, summarizing the previous estimates and (j7.97p . we have proven that 

(7.98) 11(5)'" (I-^-/") 11^1 <ZJ,n,s\\U\\x^+s. 
This ends the proof of ()7.92p . 
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Let us turn to the proof of (j7.94p . The commutator [Sjj, ZD^Gip\ ■ dki] can be expanded in a 
sum of terms under the form 

where the indices satisfy the constraints 

n>l, |7o| + |/3| + |7i| + --- + l7n-i| + l7l =2, I7I < 1- 

Consequently, in view of (j7.95p . (|7.96p . we see that the number of derivatives on is the same as 
in (j7.95p and that 1 + I7I < 2. Consequently, (j7.94p also follows from (|7.98p . This ends the proof 
of Lemma 17.231 □ 

To prove Proposition 17.21] we shall also need the following statement. 
Lemma 7.24. For m > 2 and S > 5, 

\\{dr (V • {D^A{V7^') • {VdkTj', Vd.rj', VdiTj')) - V • {D^AiVv^ ■ {Vdk^, V5,r?«, Vc?,??'^))) ||^ 1 

< ^^m,s\\U\\x"^+3- 

Proof. We first expand 

D^A(y{rj + rj'')) ■ (V9fc(r/ + r?"), Vaj(r? + r?"), V9i(r/ + r/"^)) - Ll^^W) • (V4^?^ VaJ?7^ V^ir?'^) 
as 

{D''A{V{r] + r]''))-D^A{Vr]'')) ■ (Vafc7?^ V9Jr/^ Va,??'^) 
+ D^AiV{r] + 7?")) • (VdkV, ydjr]\ VdiT]'') 

+ D^A{v{7] + 7]'')) ■ (ydk{7] + 7]'^),vdji],vdir]'') 

and we rewrite the first term as 

{D^A{Vi7] + 7?")) - W)) • (V4^", vaJ7?^ va^r/") 

= [ D^AiVisrj + r]")) ■ {r],Vdkv''ydjr]'',Vd^r]'')ds. 
Jo 

Let us observe that in all the above terms, we have at most two derivatives of rj involved. We 
can then apply V to these terms which implies that in the end we have at most three derivative 
of 7] involved. Since we need an if 2 estimate after applying (9)™", we can complete the proof of 
Lemma [7.24l bv coming back to the definition of A and using the classical Moser type estimates. □ 

End of the proof of Proposition 7.21 The combination of Lemma 17.231 and Lemma 17.241 completes 
the proof of Proposition 17.211 

Note that Proposition 17.181 and Proposition 17.211 lead to the following statement. 

Corollary 7.25. For m > 2 and S > 5, we have 

\\Gl^''['n,'P]\\x"^ < U;(||y"||yy;m+S + 1 1 1 1 X^+S ) 1 1 1 1 X^^+S • 

To end the proof of Proposition 17.171 it remains to estimate G^''. We have the following state- 
ment. 

Proposition 7.26. For m > 2 and S > 5, we have the estimate 

\\G2''['n,'P]\\x"^ <^m,s\\U\\x'^+3 ■ 
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Proof. We need to show that 

(7.99) \\{dr{I[U + V^]-I{V^])\\Hi<lo^,s\mx^-+-^ 
and 

(7.100) \\{driJ[u + n - j[n)ii^^ < uj^m,s\\u\\x-+^, 

where 

I[7], ip]=-V- {v[7], (/^]%fcr?'^) - G[v] {Z[r], ip]d^,kr]'') + G[r]]dijk^'' 

and 

J[r?, if] = /3V • (^(V77)V9,,fc7?'^) - ^]G[r;] (Z[r?, (^]9i,fc7y'^) 

-Z[7?, ip] V • t;[?7, dijkv" - v[r], if] ■ Vdijk'f'^ + Z[ry, (^JGlr^JSyfcV^" • 

Again, we observe that to get (j7.99p and (|7.100p . it suffices to use again Proposition 17.31 Proposi- 
tion [7TT3] and Lemma l7.22i All the terms that we have to handle are very similar to the ones that 
we have estimated in the proofs of Lemma 17.231 and Lemma 17.241 consequently, we shall not give 
more details. This ends the proof of Proposition 17.261 □ 

End of the proof of Proposition \7.17\ It suffices to combine the statements of Corollary 17.251 and 
Proposition 17.261 in view of (j7.68p . 

7.6. Estimates of the subprincipal terms. In this subsection, we turn to the estimates on the 
subprincipal term of ()7.67p namely the term (Q*-?^)"^ — (Q*^'^)'^. 

Proposition 7.27. For m > 2 and S > 5, we have 

(7.101) \\{drmh' - (Qf < ^m,s\mx-^- ■ 

and 

(7.102) widriiQTf - {Qfr)\\H^^ < uJn.,s\mx-+^ ■ 

Proof We first prove (j7.1()ip . Thanks to (f739l) . we need to estimate || (9)™/ijfc||^_ i with 

(and similar expression by cycle change of i,j, k). We can expand this expression as 
(Dr^G^ - D^G")a,fc¥.'^ • 9,7?" + Dr^G^djkV ■ div"" + D^G^djk^^ ■ dif] . 

Now we observe that each term in the above decomposition is in the scope of applicability of Propo- 
sition [73] or Proposition 17.13] Indeed the first term can be estimated by invoking Proposition 17. 131 
after writing 

{Dr,G^ - D^G'')d,k'p'' ■ d.rj'' = C Dp[sri + v'']djk^'' ■ (9^7?^ v)ds. 

Jo 

Observe that in this place we can afford to crudely estimate the H~2 norm by the norm con- 
trolled by Proposition 17. 13[ The second term can be estimated in H~2 by invoking Proposition 17.31 
The third term can be written as 

(7.103) Dr,G^djk^ . a,7? + Dr,G^djk^^ . diT]. 

Then the first term in the decomposition (j7.103p can be estimated in H~2 by using Proposition 17.31 
while the second term is in the scope of applicability of Proposition 17.131 again after crudely 
estimating the iJ~2 norm by the norm. This ends the proof of (j7.10ip . 
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Let us turn to the proof of ()7.102p . By using (j7.64p . a duality argument and an integration by 
parts, we obtain that the issue is to evaluate 

(7.104) \\{dr{DA{Vir]') ■ (d.Vv^djkW) - DM'^iv")) ■ (^W, 9,fcVr?")))||i2 

(and similar expression by cycle change of i,j,k). For that purpose, it suffices to observe that in 
the definition of the expression (j7.104p there are at most m + 3 derivatives of i] involved and that 
at least one of them is a spatial derivative. Then the estimate of the norm of (17.104^ follows 
from the Moser type estimates of Proposition 17.201 after some decompositions in the spirit of the 
proof of Lemma 17.241 This completes the proof of Proposition 17.271 □ 

7.7. The quadratic form associated to L^. The last step before turning to the proof of the 
energy estimates is the study of the quadratic form associated to the operator = L[U^] which 
arises as the main part of (j7.7ip . 

Proposition 7.28. We have the estimates 

(7.105) {L^W,W) + \\W\\l2 > zJ—\\W\\j^o 

(7.106) \{L^W,V)\ < cJ2,5||W^||xo||^llxo ■ 

Moreover for m>2 and S > 5 if a space-time derivative such that \a\ < m, we have 

(7.107) \{[d",L^]W,V) \ <io,n,s\\W\\x^-i\\V\\xo . 

Proof. To prove (j7.105p . as a preliminary, we shall first check the positivity of the second order 
operator V = —V • (^V) + a. This is an elliptic operator as given by: 

Lemma 7.29. There exists c > such that for every u G H^{M?), 

{-V ■ {A{Vri)Vu) + au,u) > (1 + || Vr/||ioo(K2))^^|| Vuf + a||nf 



> c(l + ||V77||i«>(K2))-3||n"2 



Proof of Lemma 7.29. Since 

.,v,) ^ ,1 . |v,P,-i ( ) . 

the statement follows from an integration by parts and the inequality 

{dyrifid^uf + {d^r,f{dyuf - 2{d^u){dyu){d^r]){dyrj) > 0. 
This completes the proof of Lemma 17.291 □ 



Note that by Sobolev embedding, we have that 
(7.108) l|Vr?iLoo < ||7?||^^4 + ||V7?'^||loo < wo,i. 

Consequently, with the notation W = {Wi,W2), we can use Lemma 17.161 and Lemma 17.291 to get 



{L^W,W) > 



IVI 2 



(1 + |V|): 



L2 



■uJ2,5\\Wi\\l2+2(d,Wi-V ■iWiv^),W2y 



Therefore (using in particular inequality (j4.26p ) we get 



{L^W,W) > J—(\\Wi\\l^ + IllVl^Wallia) -uJ2,5\\W\\l, 

1^2,5 ^ ^ 
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Using that ||W2||j|^i/2 ~ (||W2||l2 + II |V| 2 W2||i2), we obtain that 

{L^W,W) > =^(||W^l||^i + 111^2^ 1) -W2,5||W||i2 

which in turn imphes the claimed inequahty. 

To prove (I7106D . let us write W = {Wi, W2) e x and V = {Vi, V2) e x H^, then we 
have 

{L^W,V) = {V^Wi,Vi) + iG^W2,V2) + {{iv^ ■VZ^) + idt-d,)Z^)Wi,Vi) 

-(V • (v^Wi) - d^Wi, V2) - (V • (v^Vi) - d^Vi, W2) . 

We now estimate each term in the above decomposition. Coming back to the definition of using 
an integration by parts and (|7.108p we have 

\{V^Wi,Vi)\ <cJ2,5||VFi||^^i||^i||hi. 
Next using Lemma l7.16l we also have that 

|(G^W^2,^2)| <CJ2,5||T^2 11^1 11^211^1. 

Next, we can use the Sobolev embedding and Lemma 17.221 to get 

\{{{v^ -vz^) + {dt - d^)z^)Wi,Vi) \ < cj2,5l|w^iki||^illHi- 

The last two terms in the decomposition can be estimated by invoking the inequality 

\{V ■ [v^Vl) - d,Vl,W2)\ <cJ2,5||^l|bl||W^2|Li 

ri 2 

which is a direct consequence of the Sobolev embedding and Lemma [7.22l This completes the proof 
of the first inequality in our statement. Let us now turn to the proof of the second inequality. We 
can first write 

{\d'',L']W,V) < \{[d'',V']Wi,Vi)\ + \i[d'',G']W2,V2)\ 

+1 ([9", i{v' ■ VZ') + {dt - d,)Z')]Wi, Vi)\ 

+|(V • i[d'',v']Wi),V2)\ + |(V • {[d'',v']Vi),W2)\ . 

Now each term in the above decomposition can be estimated as in the proof of the first inequality by 
taking the advantage of the commutator structure and thus by using Lemma 17.231 This completes 
the proof of Proposition 17.281 □ 

7.8. Energy estimates for the main part of ()7.67p . Recall also that U{0) = 0. The goal of 
this section is to prove the following statement. 

Proposition 7.30. For m > 2, S > 5, a smooth solution of 1^7.69^ satisfy the estimate 
\\U{t)\\\^+, < a;(||i?'*^'||^™+3 + WVW^n.+s + ||?7||^^^- 



Proof of Proposition 7.30. It is more convenient to perform the energy estimate on the equation 
(j7.7ip satisfied by Wijk = PUijk- Since thanks to Lemma [Y. 221 for 5 > 5, we have 

(7.109) llW^ijfclk™ <'(^m,s\\U\\x^+3 
and 

(7.110) llf^llx^+a < ^m.gf llWjjfclU'" + llf^llx^), 
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it is equivalent to estimate Wijk or Uijk- We thus consider, for \a\ < m, the equation solved by 
d^Wijk. Namely 

(7.111) dtd'^Wijk = j[L'd"Wi,k + [5", L']W,jk - d^JPJ{{Q'^^Y - {Q'i^T)) + 
We take the LP' scalar product of (|7.11ip with 

From the skew symmetry of J and the symmetry of , we get the identity 

(7.112) J^i^^d^'W^^k.L'd^W,,,) + J°,) = Jt,k 
where 

(7.113) Tg., = [d'^W^jk, [d'',L']Wi.jk) - {d''Wijk,d''{JPJ{{Q'^')' - (Q'^'^r)), 

(7.114) = ^ {d'^W^.k, [dt, L^]d''Wi,k) + {d'^Wi^k, dt[d'', L^]Wijk) 

-{d^Wijk,dtd-{JPJ{{Q'"')' - [Q'^T)) + {M,d^{PF,^k)). 

For the proof of Proposition 17.301 we shall estimate separately all the terms arising in the energy 
identity (j7.112|) in the following sequence of Lemmas. 
We first have the following estimate for 1^°;, and J^/^- 

Lemma 7.31. For m > 2, S > 5, we have the estimates 

(7.115) \Jijk\ <'^m,s{\\U\\x"^+3\\Fijk\\x^ + \\U\\xm+3), \a\<m 
and 

(7.116) |Jj";i.| < ^m.S'll^lU^+s ||^||x™+2) |a| < m. 
Proof. Let us start with the estimate of F!j^jk- In view of (|7.113p . we can write 

'^ijk = h- h- 

From ()7.107p . in Proposition 17.281 and Cauchy-Schwarz, we immediately get 

\h\ ^'i^m,s\\U\\x"^+'AW\\x-^+'^- 

To estimate the second term, we can expand 

h = (5"T^.,fc[i],9°((Qf )^ - {^tr)) - {d^w,,k[i],d^{z\{^l^f - {^tT))) 

+ (5°VF,,fc[2],5-((Qf )^ - (Qf ^'^^ 



= Il+Il + Il 

by using the notation Wijk = {Wijk{A-,Wijk[2]y . A direct application of Proposition 17.271 vields 
and 

|/|| < ||a"T^^^-'=[2]||^i||(Qf )^- (Qf )'^||^_. <ZJ„,5||C/|U"^+3||C/|U™+2. 

Note that we have used (|7.1(J9p for the second part of the estimates. For the estimate of l|, we can 
use the following lemma: 
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Lemma 7.32. For I > 2, I < m + 1, m > 2 and S > 5, we have the estimates 

(7.117) \\{dr+'{z' - Z-)\\h^ < uJ^,s\\{dr+'U\U+^, a = 0, ^ 
and 

(7.118) |(a^(Z^((Qfy-(Qf )")),F)| <aJ„,5nix<+2||F||^i, |/3| < /. 

Let us postpone the proof of this last lemma. By a direct application of it with F = d'^W^^^[l], 
P = a, I = m and a new use of ()7.109p . we also get 

This proves (I7.116p . 

Let us turn to the estimate of cTj^^. In view of (I7.114p . we set 

J^ijk = Ji + J2 — J'i + Ja- 
By using (j7.107p in Proposition 17.281 and (j7.109p . we infer 

(7.119) l-^ll < '^m,s\\Wijk\\\ni <'ldrn,s\\U\\\rn+3 ■ 

In order to estimate J2, it suffices to write (?t [5", L^] = [5^5", + [L^ ^ dt]d°' and to apply (|7.1U7p . 
This yields 

\'h\ 

To estimate J3, we first expand 

J3 = {d''W,ju[l],dtd^{{0:tf - {^tr)) - (5"Vr,,fe[l],9<5-(Z^(Qf )'^ - (Qf )'^))) 
+ (5"W^,,fc[2],9t5"((Qf )'^ - (Qf )")) 
= Jl + Jl + Jl 

The estimate of J3 and follows by a direct application of Proposition 17.271 (changing m into 
m + 1) while the estimate of J3 is a consequence of the estimate (|7.118p of Lemma 17.321 
It remains to estimate J4. Let us write 

(M,a"(PFi,fe)) = (L^5°Vri,fe,a"(PFi,fc)) + ([5",L'^]W^i,fc,9-(PF,,fc)) 

-(9"(JPJ((Q*^'=)^ - (Q*^'=)")),5-(PF,,fc)). 

We can estimate the two first terms by using (I7.106p . (|7.107p in Proposition 17. 28} while the estimate 
of the last term follows by using again Proposition 17.271 and Lemma 17.321 This ends the proof of 
Lemma 17.311 it just remains to prove Lemma 17.321 □ 

Proof of Lemma\7.32. We start with the proof of (j7.117p . By using the same decomposition of 



Z as in the proof of Lemma 17.221 and in particular (j7.79p , we see that the proof follows from the 
following estimate on G: 

i, 0, i. 

2' ' 2 

Since 



0^-^^= / D^piri" + ST]]^ ■ T] ds 
Jo 



the needed estimate for a = —1/2 and a = 1/2 is a consequence of the refined estimate ()7.1ip in 
Remark 17.41 The estimate for a = follows by interpolation. 
To prove (|7.118p , we first write for /3i + /?2 = 

\{d''^{z')df'{{Qf)' - {Qfr),F)\ < Wd^'iiQf)' - {Qfr)\\^^i\\df^{Z')F\\^r . 
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The first term in the right hand-side of the above inequahty can be estimated by using the estimate 
(|7.10ip of Proposition 17.271 while for the second one, we use Lemma 17.121 to get 

\\d^'{Z^)F\\Hi < \\df^'{Z^ - Z'')F\\hi + \\df^'{Z'')F\\Hi 

< \\d^^{Z' - Z-)F\\hi +u;{\\V^^r.+s)\\F\\Hi. 

Next, we invoke the inequahty 

\\uv\\HiiR2) < C||n||^3^^^^||^;||Hi(M2) 

to get 

- z^fWh. < c \\d^-{z' - \\f\\h^ < c \\{dy+\z' - z-)\\^. \\f\\h. 

and hence 

\\d^'{Z^ - Z'')F\\hi <uJm.,s\P\\x^+A\F\\m <UJm,s\W\\H^ 

thanks to ()7.117p . This completes the proof of Lemma l7.32i □ 

We shall consider in addition to the energy identity (|7.112|) the following estimate: 
Lemma 7.33. Let U he a solution of {7.2^ then for m > 2 and S > 5, 

Moreover, we also have the estimate 

(7.120) \\diU\\l2 < uJ.m,s[\\ \V\dl-^U\\lo + ||f/||^™+2 + WR"" \\x^) , 4<l<m + 3. 

This Lemma will be crucial in order to get the claimed estimate of Proposition 17.301 from the 
identity (I7.112p . The first estimate will be used to compensate the fact that does not control 
the low frequencies or equivalently the norm (see ()7.105p ). The second estimate will be used to 
prove that by a suitable summation of the identities (I7.112p we get a control of the X"^^^ norm of 
W. Note that this second estimate basically states that thanks to the equation, we can replace a 
time derivative by space derivatives. 

Proof. For the estimate of the norm of U, it suffices to multiply (j7.2p by U, integrate over M? 
and use very crude estimates of all the terms. We then proceed in a similar way by taking at most 
three derivatives of the equation to get the first claimed estimate. 

To get the second estimate, we apply 9'"^ to (j7.67p . We get by taking the norm of the 
obtained equation that 

\\diU\\L2 < LOm,s(\\dt^v\\H^ + Wdt^^Wm + \\U\\x^+2) + p^^'llx-. 

We shall not give the details of this estimate which can be obtained by using the same kind of 
estimates as in Propositions 17.3 1 and 17. 13] as previously. Note that in particular the term involving 
(p arises in this form by using (j7.117p for a = 0. The idea behind this estimate is simple, the equation 
allows to replace one time derivative by one space derivative for ip and two space derivatives for rj. 
Next, since we have that 

\\M{Mdl-'v)\\L2<c\\\v\dl-'u\\xo 

and by standard interpolation that 

(7.121) wvdl-^CifWl^ < II |v|5(|v|a^^)(/p)||L2 II |v|5a^VllL2 < c||f/|U™+3||c/|U™+2, 

the result follows. This completes the proof of Lemma 17.331 □ 
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To prove Proposition 17.301 in view of ()7.112p . we shall use the energy 



We also define for m > 2, 1 < / < m, r G [0, t] 

l<\a\<l l<|a|</,Q'=0 

where a = {aQ,a') with a' = (01,02) ^-nd T > (which depends on m and t) will be carefully 
chosen. The aim of the following sequence of lemmas is to obtain the positivity of the energy in 
order to deduce an estimate from (j7.112p . We first have the following : 



Lemma 7.34. There exists F > such that for every r G [0, t], we have 

Ei,Ur) > =^\\U{t)\\%+, -LJ^,s,t\\U{r)\\li+2 

where ujm,s,t = '^(ll^"ll>v'"+'^ ll^llx'"+^) ■ 

Proof. We first consider the case that a' 7^ 0, i.e. d'^ ^ d\. In this case, we have from (|7.105p of 
Proposition 17.281 and Lemma 17.311 that 

Eo.{t) > J—\\d-W{T)\\l. - WW{t)\\1, -w^^s\\U{t)U.^, l|f/(r)||x^+2. 

Now, since contains at least one space derivative, we can write for \(3\ = |a| — 1 that 

WW{r)\\l, < ||Va^T^(r)||i. < r(T)b,+3 ||C/(r)||^,+. 

by using again the interpolation inequality (j7.12ip . Consequently, by using the Young inequality 
and (17.1101) . we find that 

(7.122) Yl ^ E ll^^f^WllxO -^m,5,i||C/(T)||x<+2r(T)||;,,+3, Vt G [0,t]. 

Now, let us consider the case that 5° = i.e. a' = 0. By the same consideration as above, we 
first get 

Eair) > ^\\dlWir)\\j,„ - \\dlW{T)\\l,-U^,s,t\\Uir)\\x'+-^ r(r)||x^+.. 
Next, from (I7.109D and (I7.120p . we get 

\\dlW{T)\\l, < uJmM Y ll^^f^WllxO + \\U{t)\\ 

This yields 

(7.123) Eair) > -^\\drW\\j,o-iOm,s,t{ V ||9"C/(r)||^o + \\U\\],t+,), Vr G [0,t]. 

Consequently, we can add (j7.122p times T sufficiently large to ()7.123p and use the Young inequality 
to get the result. This completes the proof of Lemma 17.341 □ 



Let us finally set for r G [0, t] 



E^{t)= Y T'^-'Ei^m{r) + nU{r 

l<l<m 

for r possibly larger to be chosen. We have 



2 

KKm 
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Lemma 7.35. For every t > 0, there exists T such that for every t E [0, t], we have 

Emir) > -^||[/(r)||^™+3. 
Proof. We get from Lemma 17.341 that 

1 / rm—l . 

^ r™"'ii;,,^(r) > = ||[/(r)||^„+3+ (= T^-'~'oJm,s,t)\\U{T)\\^.^s 



(r-u;„,5,t)||f/(r)|| 



2 

X3- 



Consequently, for T so that T > uJm,s,t we get 



Ern{r) > ^^||C/(t)|||„+3. 

This completes the proof of Lemma 17.351 □ 

We are now in position to end the proof of Proposition I7.30[ By using the identity (j7.112p and 
Lemma [7.311 we get 

Moreover, from the equation solved by U, we obtain that at the initial time 



|-£'m(0)| < t(j|^||i?"^||j5^m+3 + ||l^"||yym+S + 1 1 1 1 JJC™+3 j 1 1 1 1 JJ(""+3 • 

Consequently, we can integrate in time for r G [0, t] and use Lemma 17.351 to end the proof of 
Proposition 17.301 □ 

7.9. Proof of the energy estimate: proof of Theorem 17.11 It suffices to combine Proposi- 
tion 17.301 and Proposition 17.171 

7.10. Final argument. End of the proof of Theorem 11.41 In this section we complete the 
proof of Theorem 11.41 From Theorem 17. H we have for the solution of ()7.67p with initial data 
y«(0) = Q + 6U''{0) that 

(7.124) ||C/(t)||x-+3 < u;(||iZ"P||^™+3 + \\V''\\^n.+s + ||C/||^-+3) 

\R''%m+3 + f (r(T)||^™+3 + \\R''%T)\\l^^,)dT 



Using (j7.124p and some standard arguments (see the next section), we can define local strong 
solutions of the water waves equation with data Q + SU"". Note that for the argument providing 
this small time existence, the specific structure of R""^ is not of importance, one only needs to 
know that it belongs to Sobolev spaces. We now show that the estimates on R°''p provided by 
Proposition 16.31 allow to extend the solution on much longer times (sufficiently long so that we see 
the instability) . Thanks to Proposition 16.31 (with s changed into m and thus m changed into p) , we 
have the bounds 

(M+3)(Toi 

(1+t) 2P 

provided 0<t<T\0<6<5o<^l with such that 



(i + r<5)i ^' 
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where k S (0, 1) is a small number to be chosen later, independantly of 5 G (0, 5q). Coming back 
to (|7.124p . we infer that 

ft x2(M+3) 2(A/+3)(T()t 

(7.125) r(t)||^„+3 <a;(C+||C/||^™+3+KCM,™)( / \\U {T)\\\^+,dT + ), 



as far as < t < T^. Let us define T* as 

T* = sup{r : T <T\ and Vt G [0,T], ||C/||^m+3 < 1, 1 - ||7?||l- - > 0}. 

Observe that T is well-defined, at least for 5^1. Using ()7.125p . we obtain that for < t < T*, 



^2{M+3)g2(M+3)crots 

AJ+3 



(7.126) ||f/(t)|lx-+3 <u;{C + KCM,m)( [' \\U{T)\\j,^+sdT + 

We take an integer M large enough so that 2(M + 3)o"o — uj{C) > 20. At this place we fix the 
value of M. We then choose k small enough so that 1 > uj{C + nCM,m) — ^{C) ■ Such a choice of 
K is possible thanks to the continuity assumption on lo. We also observe that for ^ > 1 and p > 0, 
there exists C such that for every t > 0, we have the inequality 



(7.127) / -dT<C,^ , . 

Thanks to (j7.126p . (|7.127p and the choice of M and k, we can apply a bootstrap argument and the 
Gronwall lemma, we infer that U{t) is defined for t G [0, T^] and that 

(7.128) sup ||C/(t)||x™+3 < CM,m«*'^+^ 

0<t<T* 

The bound (|7.128p implies in particular that 

Let / be the time interval involved in the definition of (see (|6.5p ). Let us fix ^ G Cq°(M) which 
equals one on / and which vanishes near zero. Let 11 be a Fourier multiplier on ]R|^ with symbol 

9(^2) (i-e. cutting the zero frequency in y). The map 11 is bounded on L^(M^). We also have that 
Il{U^) = U^. Therefore, using Proposition 16.11 and Proposition 16.31 we obtain that for every t > 

||n(5c/'^(t))IU.(K2) > c6 ^_ ^5^-+i||n(f/xt))IU.(R2) 

> c6^^ - Cm ^• 

{l + t)^p j=i (l + t)2p 

Thus for At ^ 1, 

||n(<5i7'^(T^))||^.(K2)>y, Vt>0. 

Observe that for every a G M, Il{Q{- — a)) = 0. Recall that the true solution with data Q+5U^{0) 
is decomposed as = Q + dV^ + U. In particular at time zero is 5 close to Q in any H'^iM?). 
On the other hand, for every a G M, we can write 

\\U\T',-)-Q{.-a)\\L2 > cmu\T\-)-Q{.-a))\\L2 

= cmu\T',.)-Q{.))\\L^ 
= c\\Ii{6U%T') + U{T'))\\L2 
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provided k <^ 1 (independantly of 5) . This completes the proof of Theorem II. 4[ 



8. Sketch of the existence proof 



In this section, we sketch an existence proof by a vanishing viscosity type method for (j7.2p . The 
local existence of a smooth solution for (j6.1|) in Sobolev spaces (which corresponds to the study of 
(j7.2p when = was already obtained in [27] by using the Nash-Moser iteration scheme or in [3] 
by using a subtle Lagrangian type formulation of the problem, we also refer to the work [11], [M] 
for the case with vorticity. 

The aim of the following is to sketch a simple proof which avoids the use of a complicated 
iteration scheme. 

For a positive number v, we consider the system 



By standard arguments, for every positive i^, one can get a solution of (j8.ip in C{[0,T'^], H'^) 
for some T'^ > when s > sq is sufficiently large (s > 3). Indeed, we can use Propositions 17.3 1 17. 131 
and Remark 17.111 in the classical Sobolev framework (i.e. without the time derivative, since the 
time is only parameter in these propositions, their statement remain obviously valid if one replace 
9 by V). Prom these estimates, the local existence for (18. ip follows from Duhamel formula and the 
Banach fixed point Theorem. We also get that the solution can be continued as long as the H^'' 
norm for some sq sufficiently large remains bounded. 

The next step is to prove that the existence time of is uniform in v i.e. we have to prove 
that for some T > 0, we have T'^ > T > 0, for every v G (0, 1]. Towards this, it suffices to prove 
that the norm of Lf^ cannot blow-up on [0, T] for some positive T independent of v. The main 
idea is that the estimate of Theorem 17.11 still holds for ()8.ip uniformly in v. By using the same 
transformation as in Section 17.4.21 we find that (j7.7ip is changed into 



of clarity) and the subprincipal term Q*-^'^ and F which contains the semilinear terms G^-^'' are the 
same as previously (in particular, F is given by (I7.70|) ). In particular they still satisfy with uj 
independent of v the estimates of Proposition 17.271 and Proposition 17.171 The only new terms that 
show up are the diffusion term —u and TZ"^ which is defined as 



Our goal is to perform energy estimates, uniform in G (0, 1] to (j8.2p . Such estimates follow the 
same lines as the energy estimates we performed for v = 0. One should take care of the terms 
coming from the dependence. Our situation is slightly different from the classical one because 
of the presence of TZ'^ coming form the transformation Wyk = PUijk- The point is that, thanks 
to the parabolic term — i^A^, the contributions of the terms containing v can be put in norms 
containing two more derivatives with respect the energy level. For instance, the estimates on Z^, 
we already established are strong enough to control the contribution oiTZ'^. More precisely, thanks 
to Lemma 17.221 we can estimate in norms containing two more derivatives with respect to the 
energy level. This essentially explains the approach to energy estimates for the equation (j8.2p . 
By applying d" to (18. 2p , we deduce the energy identity which is the straightforward generalization 



(8.1) 




(8.3) 




of (TTTni) 
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where T^-^ and J^^^ are still given by (17.1131) . (17.1141) and 

+(a"7^^9"JPJ((Q*■'■'=)'^ - 

In view of the estimates of Section 17.81 it suffices to estimate T)^ uniformly in v. Let us start 
with the estimate of the first term which will give the parabolic regularisation term. By using an 
integration by parts, we have 

(8.4) - v^^^d'^Wijk.L^d'^Wijk) = -i^{Ad''Wijk,L^Ad''Wijk) - i^{Ad''Wijk, [A,L^]d''Wijk)- 
By using estimates as in Proposition 17.281 we get the estimate 

(8.5) -,y{A^d''Wi,k,L^d''Wi,k) 

< -^llAd'^W.jkllxo + '^llAd'^W^jkllh + i^iOi^sU^^^ 
provided / > 2 and 5 > 5. Next, from standard interpolation in Sobolev spaces, we infer for every 

C>o 

for some C(C) > independent of G (0, 1] and hence, we can choose ^ sufficiently small to get 

(8.6) uWAd'^W^.kWl^ + i^iOi,s\\{V)d''Wijk\\xo\\AWijk\\x' < j^WAWijkfxi + uJ,,s||f/||?+3- 

4 0^2,5 

This yields thanks to (|8.5p 



(8.7) - i^{A^d''Wijk,L^d''Wijk) < --^WAd'^WijkWxo + cJ,,5||t/||'+3- 

4 i02,5 

Next, we can study the second term in the right hand-side of the expression defining D^. From the 
form (|8.3p of TZ'^, we first get 



+v (9° ([Z^ A^]Wijk[l]) , G'd''Wijk[2] 
(8.8) = R'[ + R^. 

Let us start with the estimate of i?2 which is the most difficult term to handle. Expanding the 
commutator, we need to estimate 

i^(d''{V^Z'V^Wijk[l]),G'd''Wijk[2]), \P\ + ItI = 4, ItI < 3. 



Using integrations by parts, we redistribute the 4 derivatives of and equally to both sides 
of the above scalar product. In addition, we invoke Lemma 17.221 to deal with the contribution. 
This leads to 



z.|(a"(V^zV^I^,,fc[l]),G^a"I^,,-fc[2]j| < Ci^\\AWijk\\x^+C{(:pi^s\\U\\%+3. 
Coming back to (|8.8p . the term can be estimated in a similar way. Consequently, we find 
(8.9) |(a"7^^L'^9°VF,,•fc)| < Cu\\AWijk\\xi+C{C)uJi,s\\U\\%+3 ■ 

The third and the fourth terms in the expression defining P'^ can be handled very similarly. Finally, 
the last two terms can be estimated by using estimates like in Proposition 17.271 (here one needs 
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to revisit the proof of Proposition 17.271 and to follow more carefully the dependence in uJm,s)- In 
summary, we get the following estimate 

(8.10) < -^^^IIAiy,^.;,!!^, +Ci.||Al^i,fe||^, +C(CK5||C/||'+3- 

From the energy identity, we can use Lemma 17.311 Lemma 17.341 and Lemma 17.351 as in Section 17.81 
to get the energy estimate 




By choosing ( < 1/2, we thus get the uniform estimate 




< u:{\\R-P\\^,+s + WV^^^+s + w+3)(|i?z(0)| + r \\U{T)\\%+,dT). 

t t t Jq 

In particular 

Ei{t) < c^(||i?'^f||^,+3 + ||l/1lw^+s + {\Em\ + \\U{T)\\%+^dT). 

From Lemma [7.35l and a standard continuation argument, this yields that ||f^''(i)llx'+3 is bounded 
uniformly in v on an interval of time [0, T] independent of v. This allows to use strong compactness 
arguments in a classical way in order to prove that a subsequence of converges locally strongly 
in iJ^o to a solution of ([72]) ■ 
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